Design and maintain scalable data infrastructure on Google Cloud Platform. You will own the implementation of data pipelines and infrastructure as code.
Responsibilities
Build and optimize data pipelines using Apache Beam, Dataflow, and Spark.
Manage cloud infrastructure and deployments via Terraform and Jenkins.
Orchestrate workflows and manage data storage with Airflow, Cloud SQL, and BigQuery.
Deploy and manage containerized services on GKE or other Kubernetes environments.
Required Skills
6-15 years of professional software engineering experience.
Deep expertise in Google Cloud Platform services: BigQuery, GCE, Pub/Sub, Cloud SQL, Dataflow, Dataproc.
Strong proficiency with Apache Beam and Apache Spark for data processing.
Hands-on experience with Apache Airflow for workflow orchestration.
Proven ability to write and maintain Terraform code for infrastructure provisioning.
Experience with CI/CD pipelines using Jenkins.
Experience with Kubernetes (GKE) or equivalent managed services in AWS/Azure.
Any Graduate degree.
Preferred Skills
Experience with multi-cloud Kubernetes environments (AWS EKS or Azure AKS).