Description

You will design and implement data pipelines within the Google Cloud ecosystem.

Responsibilities

• Build and maintain streaming data pipelines using Pub/Sub and Dataflow.
• Develop data processing logic using Apache Beam with Java or Python.
• Manage large-scale data storage and retrieval using Google Cloud Storage and BigQuery.
• Optimize data workflows to ensure efficient processing and delivery.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency with Google Cloud Platform services including BigQuery and Google Cloud Storage.
• Hands-on experience with Dataflow and Pub/Sub for streaming workloads.
• Strong programming skills in Java and Python.
• Experience implementing data processing with Apache Beam.
• Degree in any graduate field.

Preferred Skills

• Experience with Airflow.
• Knowledge of Google Dataform.

Key Skills

Education

Any Graduate