Description

You will design, build, and deploy scalable data pipelines within the Google Cloud Platform ecosystem.

Responsibilities

• Design and deploy scalable data pipelines using Google Cloud Dataflow.
• Leverage BigQuery for data analytics with a focus on performance and cost efficiency.
• Manage workflow orchestration and automation through Cloud Composer.
• Monitor, troubleshoot, and optimize pipelines to ensure data quality and integrity.
• Document data architectures, processes, and data lineage.

Required Skills

• 3-4 years of experience as a data engineer with significant exposure to Google Cloud Platform.
• Expertise in GCP Dataflow, BigQuery, and Cloud Composer.
• Strong proficiency in Java, Python, and Apache Beam.
• Experience with streaming and messaging systems such as Kafka, Pulsar, GCP PubSub, or RabbitMQ.
• Experience implementing connectors for systems like Cassandra.
• Familiarity with GCP Cloud Storage and Dataproc.
• Experience leading delivery streams.
• Bachelor's degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Familiarity with other cloud platforms such as AWS or Azure.

Key Skills

Education

Any Graduate