Description

You will lead the design and implementation of end-to-end data pipelines using GCP services.

Responsibilities

• Architect and optimize data lake and data warehouse solutions for scalability and performance.
• Define and implement data ingestion, transformation, and integration strategies using batch and streaming methods.
• Collaborate with data scientists, analysts, and business stakeholders to define data requirements and deliver insights.
• Enforce data governance, security, and quality best practices across data workflows.
• Mentor engineering team members and automate workflows using CI/CD and Infrastructure-as-Code.

Required Skills

• Bachelor's or Master's degree in Computer Science or related field.
• 7–10 years in data engineering, with 3+ years in a lead role.
• Strong hands-on expertise with GCP services: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Composer.
• Proficiency in Python and SQL for data processing and automation.
• Experience with ETL/ELT design, data modeling, and data warehousing principles.
• Working knowledge of distributed data frameworks like Apache Beam or Spark.
• Experience implementing CI/CD pipelines and IaC using Terraform or similar tools.
• Familiarity with orchestration frameworks such as Airflow or DBT.

Key Skills

Education

Bachelor's or Master's degrees