Description

You will design, build, and deploy scalable data pipelines within Google Cloud Platform. You own the release and optimization of these systems to ensure data quality and cost efficiency.

Responsibilities

• Build and deploy scalable data pipelines using Google Cloud Dataflow.
• Optimize BigQuery for data analytics, performance, and cost efficiency.
• Manage workflow orchestration and automation via Cloud Composer.
• Monitor and troubleshoot pipelines to ensure data quality and integrity.
• Document data architectures, processes, and lineage for maintainability.

Required Skills

• 4+ years of experience in data engineering with significant GCP exposure.
• Expertise in Google Cloud Dataflow, BigQuery, and Cloud Composer.
• Proficiency in Java, Python, and Apache Beam.
• Experience with streaming and messaging systems such as Kafka, Pulsar, GCP PubSub, or RabbitMQ.
• Experience implementing connectors for systems like Cassandra.
• Familiarity with GCP services including Cloud Storage and Dataproc.
• Experience leading delivery streams.
• Bachelor's degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Familiarity with other cloud platforms such as AWS or Azure.

Key Skills

Education

Any Gradute