Description

You will design and build scalable data pipelines on GCP, optimizing BigQuery and Dataproc for performance and cost.

This role is hybrid.

Responsibilities

• Design, build, and optimize scalable data pipelines on GCP.
• Develop and manage batch and large-scale data processing solutions using Dataproc (Spark).
• Architect and optimize BigQuery datasets, schemas, and queries for performance and cost.
• Implement data quality checks, monitoring, and performance tuning.
• Collaborate with business and analytics stakeholders to translate requirements into data solutions.

Required Skills

• Hands-on expertise with GCP, specifically BigQuery and Dataproc.
• Strong proficiency in SQL and Spark (PySpark/Scala).
• Experience with orchestration tools and pipeline automation.
• Knowledge of CI/CD, cloud monitoring, logging, and alerting.
• Understanding of data security, access controls, and cost optimization on GCP.
• 6+ years of experience as a Data Engineer.

Preferred Skills

• Experience with Composer, Dataflow, Pub/Sub, or similar services.
• GCP Professional Data Engineer certification.

Key Skills

Education

Bachelor's degree