Description

Lead the architecture and implementation of large-scale distributed data systems on Google Cloud Platform.

Responsibilities

• Design, develop, and maintain scalable batch and real-time data processing pipelines.
• Architect scalable solutions using Google Cloud Platform services.
• Build and manage data pipelines within large-scale distributed systems.
• Maintain and optimize data processing workflows for reliability and scale.

Required Skills

• 10+ years of experience designing and building data pipelines in distributed systems.
• Proficiency with Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, and GCS.
• Strong experience with the Hadoop ecosystem (HDFS, Hive, Pig, HBase, YARN).
• Advanced proficiency in Python for data engineering and scripting.
• Advanced proficiency in Scala for data engineering.
• Hands-on experience with HBase.
• Degree in any graduate field.

Key Skills

Education

Any Graduate