Description

You will build and manage data pipelines and infrastructure using Google Cloud Platform.

This role is remote.

Responsibilities

• Develop and maintain data processing workflows using Apache Beam and Dataflow.
• Manage large-scale data processing jobs with Dataproc and Apache Spark.
• Orchestrate complex data pipelines using Airflow.
• Provision and manage cloud infrastructure using Terraform.
• Deploy and manage containerized workloads using GKE or other Kubernetes environments.

Required Skills

• 5+ years of professional experience in data engineering or cloud infrastructure.
• Hands-on experience with GCP BigQuery and Cloud SQL.
• Proficiency with GCE Pub/Sub for messaging services.
• Deep understanding of Apache Beam and Dataflow.
• Experience with Dataproc and Apache Spark.
• Practical knowledge of Airflow for orchestration.
• Strong Terraform coding experience for Infrastructure as Code.
• Experience with GKE, or Kubernetes on Azure or AWS.
• Familiarity with Jenkins for CI/CD.

Preferred Skills

• Experience working with AWS environments.

Key Skills

Education

Any Graduate