Description

You will build and maintain a big data platform handling 100-200 billion events per day. You own the architecture for massive scale, covering both streaming and batch ingestion pipelines.

Responsibilities

• Build and maintain the big data platform using Kafka, Spark, Storm, and Hadoop/Hive.
• Develop and maintain streaming and batch ingestion pipelines.
• Architect systems designed for massive scale.
• Build automation tools for the data platform.
• Implement platform and application level alerting and monitoring.

Required Skills

• 5+ years of experience in data environments.
• Hands-on expertise with Kafka, Spark, Storm, Hadoop, or Hive.
• Proficiency with AWS.
• Strong scripting skills using Python.
• Solid Linux skills.
• Experience with Key/Value stores.
• Bachelor's degree or equivalent graduate level education.

Key Skills

Education

ANY GRADUATE