Description

You will design and optimize scalable data pipelines on Google Cloud Platform.

Responsibilities

• Architect and optimize BigQuery datasets, schemas, and queries for performance and cost.
• Develop large-scale batch processing solutions using Dataproc (Spark).
• Implement data quality checks, monitoring, and performance tuning.
• Collaborate with stakeholders to translate business requirements into technical data solutions.
• Contribute to documentation and mentor junior engineers.

Required Skills

• 6+ years of experience as a Data Engineer.
• Hands-on expertise with GCP, specifically BigQuery and Dataproc.
• Strong proficiency in SQL and Spark (PySpark/Scala).
• Experience with orchestration tools and pipeline automation.
• Knowledge of CI/CD, cloud monitoring, logging, and alerting.
• Understanding of data security, access controls, and cost optimization on GCP.

Preferred Skills

• Experience with Composer, Dataflow, Pub/Sub, or similar services.
• GCP Professional Data Engineer certification.
• Exposure to enterprise data platforms and large datasets.

Key Skills

Education

Bachelor’s degree