Description

Design, build, and maintain scalable data solutions within the Google Cloud Platform ecosystem.

Responsibilities

• Design, build, and deploy scalable data pipelines using Google Cloud Dataflow.
• Optimize BigQuery for performance and cost efficiency during data analytics.
• Manage workflow orchestration and automation through Cloud Composer.
• Monitor and troubleshoot pipelines to ensure data quality and integrity.
• Document data architectures, processes, and data lineage.

Required Skills

• 4+ years of experience in data engineering with significant GCP exposure.
• Deep expertise in Google Cloud Dataflow, BigQuery, and Cloud Composer.
• Proficiency in Java, Python, and Apache Beam.
• Experience with streaming and messaging systems such as Kafka, Pulsar, GCP PubSub, or RabbitMQ.
• Experience implementing connectors for systems like Cassandra.
• Familiarity with GCP Cloud Storage and Dataproc.
• Bachelor's degree in Computer Science or Engineering.

Preferred Skills

• Experience with other cloud platforms including AWS or Azure.

Key Skills

Education

Bachelor's degree in Computer Science, Engineering