Description

You will design, build, and maintain scalable data infrastructure and pipelines on Google Cloud Platform.

Responsibilities

• Build and optimize data pipelines using Apache Beam, Dataflow, and Spark.
• Implement infrastructure as code and manage cloud deployments via Terraform and Jenkins.
• Orchestrate workflows and manage data storage with Airflow, Cloud SQL, and BigQuery.
• Deploy and manage containerized services on GKE or other Kubernetes environments.

Required Skills

• 6-15 years of professional software engineering experience.
• Deep expertise in Google Cloud Platform services: BigQuery, GCE, Pub/Sub, Cloud SQL, Dataflow, Dataproc.
• Strong proficiency with Apache Beam and Apache Spark for data processing.
• Hands-on experience with Apache Airflow for workflow orchestration.
• Proven ability to write and maintain Terraform code for infrastructure provisioning.
• Experience with CI/CD pipelines using Jenkins.
• Experience with Kubernetes (GKE) or equivalent managed services in AWS/Azure.

Preferred Skills

• Experience with multi-cloud Kubernetes environments (AWS EKS or Azure AKS).

Key Skills

Education

Any Graduate