Description

You will design, build, and optimize data pipelines within a Google Cloud environment. You own the full lifecycle of data workflows, from ingestion to storage.

Responsibilities

• Design and build scalable data pipelines using Apache Beam and Dataflow.
• Optimize data processing workflows using Google Cloud Composer and Dataproc clusters.
• Implement database CDC ingestion processes for real-time data availability.
• Automate data processes and develop applications using Java and Python.
• Manage and maintain data workloads across Hadoop and BigQuery environments.

Required Skills

• 5+ years of experience in data engineering and pipeline design.
• Proficiency with Google Cloud Composer and Dataflow.
• Experience managing Dataproc clusters and Apache Beam.
• Hands-on experience with BigQuery and Hadoop.
• Strong programming skills in Java and Python.
• Experience with Unix environments and PL/SQL.
• Practical knowledge of Database CDC ingestion.

Preferred Skills

• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate