Description

You will develop and maintain data pipelines for real-time and hourly batch processing.

This role is on-site.

Responsibilities

• Build and maintain scalable data pipelines for internal and external stakeholders.
• Implement new data exports and update business logic for various feeds.
• Support billion-scale streaming data pipeline infrastructure.
• Ensure data quality and integrity throughout ingestion and processing.

Required Skills

• 5+ years of professional development experience with Scala.
• Practical knowledge of Apache Kafka for data streaming.
• Familiarity with Spark Structured Streaming in Scala.
• Understanding of AWS cloud technologies (S3, Athena, EC2, IAM, EMR).
• Experience with Git for version control.
• Strong grasp of Data Streaming concepts.

Preferred Skills

• Experience with billion-scale data infrastructure.

Key Skills

Education

Any Gradute