Description

This role involves building and maintaining data infrastructure solutions.

Responsibilities

• Build and maintain ETL pipelines using Google Cloud Dataflow.
• Process batch and streaming data in real-time environments.
• Manage and operate large-scale datasets using Google Cloud Dataproc for Hadoop and Spark clusters.
• Implement real-time data streaming and message processing using Cloud Pub/Sub.

Required Skills

• 10+ years of professional experience.
• Expert proficiency in Python.
• Hands-on experience with Google Cloud Dataflow for ETL Pipelines.
• Experience processing batch and streaming data.
• Proficiency in Google Cloud Dataproc for Hadoop and Spark.
• Familiarity with Cloud Pub/Sub for real-time data streaming.
• Understanding of general Google Cloud concepts.

Key Skills

Education

Any Graduate