Description

Build and manage data processing systems and pipelines within the Google Cloud Platform ecosystem. You will own the full lifecycle of data applications, from architecture to deployment and cost optimization.

Responsibilities

• Build and maintain data pipelines using Dataflow, Dataproc, Apache Beam, Apache Airflow, and Cloud Composer.
• Implement CI/CD pipelines for data applications using Cloud Build, Jenkins, or Gitlab to automate testing, packaging, and deployment.
• Manage cloud infrastructure and data warehouse solutions, specifically BigQuery and Data Lakes.
• Optimize data infrastructure performance and implement FinOps strategies for cost control.
• Secure data environments through encryption, service account management, and secret management.

Required Skills

• Hands-on experience with Google Cloud Platform (GCP) services including BigQuery, Cloud Dataflow, Cloud Composer, Cloud Functions, Cloud Pub/Sub, and GKE.
• Proficiency in Python, Spark, and Scala.
• Working knowledge of SQL, NoSQL, and RDBMS.
• Experience with container technology such as Docker.
• Proficiency in version control using GitHub.
• Experience with build management and CI/CD tools like Jenkins or Concourse.
• Strong programming skills in Python and Linux Shell.
• Understanding of application architecture and cloud design considerations.

Preferred Skills

• Google Cloud Certification.
• Knowledge of streaming tools like Kinesis or Kafka.
• Experience with AWS or Azure.

Key Skills

Education

Any Graduate