Description

You will lead the design and implementation of large-scale data engineering solutions for petabyte-scale environments.

This role is on-site.

Responsibilities

• Design and optimize data ingestion and modeling processes.
• Orchestrate complex data pipelines using workflow management tools.
• Implement and maintain CI/CD pipelines and automation for data workflows.
• Ensure data platform reliability through monitoring and operational automation.
• Translate business needs into technical data solutions with stakeholders.

Required Skills

• 10+ years of overall IT experience.
• Expert-level proficiency in Python, including data engineering libraries.
• Advanced SQL for complex querying and performance tuning.
• Extensive hands-on experience with Google Cloud Platform (GCP) services.
• Proven experience with data pipeline orchestration tools (e.g., Apache Airflow, Cloud Composer).
• Proficiency with CI/CD pipelines and version control (Git).
• Experience with data processing frameworks like Cloud Dataflow/Beam or Pub/Sub.
• Familiarity with GitLab CI/CD, GitHub Actions, or Jenkins.
• Knowledge of Docker and Kubernetes.

Key Skills

Education

Any Graduate