Description

You will build and maintain data processing pipelines and systems within a hybrid cloud environment.

Responsibilities

• Partner with Program, Data Science, and Engineering teams to define analytics data requirements.
• Design and build data processing pipelines in a hybrid cloud environment.
• Design data models optimized for storage and retrieval.
• Develop new data processing systems to enable efficient data consumption and augmentation.
• Build CI/CD pipelines for Analytics Platform needs and implement methods to monitor data quality.

Required Skills

• 5+ years of experience in software engineering or data processing platform development.
• Proficiency with Java or Scala.
• Experience with Spark, Hadoop, MapReduce, and SparkSQL.
• Strong command of SQL or other declarative data extraction languages.
• Experience with Amazon Web Services (AWS).
• Experience with Gradle or similar build automation systems.
• Experience with real-time data processing using Kafka and Storm or Spark Streaming.
• Experience with big data processing platforms and framework development.
• Degree in Computer Science or a related field.

Preferred Skills

• Experience with GCP or Azure.

Key Skills

Education

Any Graduate