Description

You will lead the design, development, and deployment of complex data pipelines and end-to-end engineering solutions.

Responsibilities

• Design, develop, and maintain complex applications to support data processing workflows.
• Build and manage data pipelines and orchestration workflows using Apache Airflow on GCP.
• Integrate data from multiple sources into Google BigQuery and Google Cloud Storage (GCS).
• Write and optimize advanced SQL queries for ETL/ELT processes.
• Implement data quality checks, data contracts, and governance processes to ensure accuracy.
• Mentor junior engineers and provide technical leadership during project planning and execution.

Required Skills

• 6-8 years of experience leading the design and deployment of complex data pipelines.
• Strong working knowledge of Apache Airflow on GCP for pipeline orchestration.
• Hands-on experience integrating data into Google BigQuery and GCS.
• Proficiency in writing and optimizing complex SQL queries for large-scale processing.
• Practical experience with containerization using Docker and Kubernetes.
• Experience implementing data governance and security best practices.
• Familiarity with Agile methodologies and cross-functional team collaboration.
• Experience with CI/CD pipelines and DevOps practices for data workflows.

Preferred Skills

• Technical leadership experience in managing end-to-end data engineering initiatives.

Key Skills

Education

Any Graduate