Description

Key Skills: GCP, Data Engineer, Data Engineering, Pyspark, Ms Sql, Python

Roles and Responsibilities:

• Develop and maintain ETL/ELT pipelines on GCP using BigQuery, Dataflow, Beam, and related services.
• Design data models and implement data warehousing patterns in BigQuery.
• Build and orchestrate workflows using Cloud Composer (Apache Airflow) and scheduled pipeline execution.
• Integrate data ingestion and event-driven components using Pub/Sub, Cloud Storage (GCS), and Cloud Functions.
• Collaborate on API integrations and production readiness, including version control and CI/CD practices.

Skills Required:

• 5 - 10 years of relevant data engineering experience
• Google Cloud Platform (GCP) data engineering experience
• BigQuery and SQL for data warehousing and querying
• Cloud Dataflow and Apache Beam for scalable data processing
• Cloud Composer (Apache Airflow), GCS, Pub/Sub, Cloud Functions, and Dataproc; Python for pipeline development

Good to Have:

• PySpark
• MS SQL

Education: Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience)

Key Skills

Education

Any Graduate