Description

You will design and manage data pipelines within the Google Cloud Platform ecosystem.

Responsibilities

• Build and maintain data processing workflows using Dataproc and Dataflow.
• Manage large-scale datasets using BigQuery and Bigtable.
• Orchestrate complex data pipelines with Cloud Composer and Airflow.
• Implement real-time data streaming using Pub/Sub and Datastreams.
• Operate independently to deliver data solutions with minimal guidance.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python, Java, or Scala.
• Expertise in ANSI-SQL.
• Hands-on experience with GCP BigQuery and GCP Cloud Composer.
• Experience with GCP Dataflow, Dataform, and Datafusion.
• Working knowledge of GCP Dataproc and GCP Datastreams.
• Experience with GCP DMS, GCP Pub/Sub, and GCP Storage.
• Familiarity with GCP Workflows and Google Analytics Hub.
• Ability to work with Bigtable and Apache Airflow.

Key Skills

Education

Any Graduate