Description

You will design and maintain scalable data pipelines within the Google Cloud ecosystem, owning the full lifecycle from ingestion to warehousing.

Responsibilities

• Build and manage scalable data workflows using Google Dataflow and Airflow.
• Develop data processing applications using Python and Java.
• Implement real-time streaming architectures with Kafka and Google Pub/Sub.
• Manage data warehousing operations and optimization within BigQuery.
• Write shell scripts to automate routine data engineering tasks and support EDW reporting.

Required Skills

• 10+ years of experience in data engineering roles.
• Extensive hands-on experience with Google Cloud Platform (GCP).
• Proficiency in Python and Java for data processing applications.
• Deep knowledge of BigQuery (BQ) and data warehousing operations.
• Experience implementing Kafka for stream processing.
• Strong shell scripting skills for automation.
• Experience with Google Airflow for orchestration.
• Experience with Google Pub/Sub.
• Proven ability in reporting and analytical requirements for EDW data.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate