Description

You will own the design, development, and maintenance of scalable data pipelines on Google Cloud Platform, ensuring reliable data transformation and delivery for clients.

Responsibilities

• Build and maintain data pipelines using Airflow and Python within the GCP ecosystem.
• Execute complex data transformations and advanced querying using SQL and BigQuery.
• Automate deployment processes by implementing and managing CI/CD pipeline automation.
• Collaborate with clients and offshore teams to define requirements and ensure effective communication.

Required Skills

• 10+ years of total professional experience, including 5+ years in Data Engineering.
• Hands-on proficiency with SQL and BigQuery for complex data manipulation.
• Strong experience with Google Cloud Platform (GCP) services.
• Practical experience with Apache Airflow (specifically AFaaS or DPaaS).
• Working knowledge of Python for data engineering tasks.
• Proven experience with CI/CD pipeline automation and deployment strategies.

Preferred Skills

• Experience working with retail, eCommerce, or customer datasets.

Key Skills

Education

Not specified