Description

You will own the design, development, and maintenance of data pipelines on Google Cloud Platform, ensuring scalable data transformation and reliable delivery for clients.

Responsibilities

• Build and maintain robust data pipelines using Airflow and Python within the GCP ecosystem.
• Execute complex data transformations and perform advanced querying using SQL and BigQuery.
• Automate deployment processes by implementing and managing CI/CD pipeline automation.
• Collaborate directly with clients and offshore teams to define requirements and ensure effective communication.

Required Skills

• 10+ years of total professional experience, including 5+ years dedicated to Data Engineering.
• Hands-on proficiency with SQL and BigQuery for complex data manipulation.
• Strong experience with Google Cloud Platform (GCP) services.
• Practical experience with Apache Airflow, specifically AFaaS or DPaaS.
• Working knowledge of Python for data engineering tasks.
• Proven experience with CI/CD pipeline automation and deployment strategies.

Preferred Skills

• Experience working with retail, eCommerce, or customer datasets.

Key Skills

Education

Not specified