Description

You will design, develop, and optimize ETL/ELT data pipelines within a GCP environment.

Responsibilities

• Design and optimize data pipelines using Dataproc, BigQuery, Cloud Composer, and Cloud Storage.
• Write efficient PySpark and SQL code to process large-scale datasets.
• Tune complex SQL queries and data workflows for performance and scalability.
• Lead technical design discussions and architecture reviews.
• Implement and maintain CI/CD pipelines and DevOps processes for data workflows.

Required Skills

• 7+ years of experience in Data Engineering roles.
• 4+ years of hands-on experience with GCP tools including BigQuery, Dataproc, Cloud Composer (Airflow), and Cloud Storage.
• Strong programming skills in PySpark and data transformation frameworks.
• Expertise in writing and tuning complex SQL queries.
• Solid understanding of data modeling, data warehousing, and distributed data processing.
• Hands-on experience with CI/CD pipelines and DevOps processes in a data context.
• Any Graduate degree.

Preferred Skills

• Experience building real-time streaming pipelines using Cloud Pub/Sub and Cloud Functions.

Key Skills

Education

Any Graduate