Description

You will build and manage data processing systems and pipelines within the Google Cloud Platform ecosystem.

Responsibilities

• Build and maintain data pipelines using Dataflow, Dataproc, Apache Beam, Apache Airflow, and Cloud Composer.
• Implement CI/CD pipelines for data applications using Cloud Build, Jenkins, or Gitlab to automate testing, packaging, and deployment.
• Manage cloud infrastructure and data warehouse solutions, specifically BigQuery and Data Lakes.
• Optimize data infrastructure performance and implement FinOps strategies for cost control.
• Secure data environments through encryption, service account management, and secret management.

Required Skills

• Hands-on experience with Google Cloud Platform (GCP) services.
• Proficiency in Python, Spark, and Scala.
• Experience with BigQuery, Cloud Dataflow, Cloud Composer, Cloud Functions, Cloud Pub/Sub, and GKE.
• Working knowledge of SQL, NoSQL, and RDBMS.
• Experience with container technology such as Docker.
• Proficiency in version control using GitHub.
• Experience with build management and CI/CD tools like Jenkins or Concose.
• Understanding of application architecture and cloud design considerations.
• Strong programming skills in Python and Linux Shell.

Preferred Skills

• Google Cloud Certification.
• Knowledge of streaming tools like Kinesis or Kafka.
• Experience with AWS or Azure.

Key Skills

Education

Any Graduate