Description

You will design and optimize scalable data pipelines on Google Cloud Platform, focusing on BigQuery, GCS, and Dataflow. You own the end-to-end lifecycle from ingestion to visualization, ensuring data quality and performance for business stakeholders.

Responsibilities

• Build and maintain ETL pipelines using Dataflow, Pub/Sub, and GCS to process real-time and batch data.
• Write complex SQL queries and manage BigQuery DDLs, views, and permissions for secure data access.
• Develop interactive dashboards in Looker Studio and automate weekly/monthly SQL reports for distribution.
• Implement event-driven architectures and API-integrated workflows to extract and transform external data.
• Perform DEV and UAT testing to validate business logic, data quality, and pipeline stability.

Required Skills

• 5+ years of experience with SQL and BigQuery in large-scale data environments.
• Hands-on proficiency with GCP services: BigQuery, GCS, Dataflow, and Pub/Sub.
• Strong Python skills for data manipulation and pipeline development.
• Experience with Apache Airflow or similar orchestration tools.
• Solid understanding of data modeling, ETL best practices, and performance tuning.
• Bachelor’s degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Exposure to Java-based data processing frameworks.
• Experience in client-facing or consulting environments.

Key Skills

Education

Bachelor's degree