Description

You will design and maintain scalable data pipelines on Google Cloud Platform.

This role is hybrid.

Responsibilities

• Build and optimize ETL/ELT workflows using Python and PySpark.
• Process large-scale datasets using Apache Spark.
• Implement and manage GCP services including BigQuery, Dataproc, Dataflow, Cloud Storage, Cloud Composer, and Pub/Sub.
• Ensure data quality, performance optimization, and reliability of data pipelines.
• Troubleshoot production issues and implement performance improvements.

Required Skills

• 10+ years of experience in data engineering.
• Strong proficiency in Python and PySpark.
• Hands-on experience with Google Cloud Platform services.
• Expertise in BigQuery, Dataproc, and Dataflow.
• Bachelor's degree in a relevant field.
• Experience collaborating with cross-functional teams to define requirements.
• Proven ability to troubleshoot complex production issues.

Key Skills

Education

Bachelor's degree