Description

You will build and maintain scalable data pipelines using distributed computing frameworks to support batch and streaming solutions.

This role is on-site.

Responsibilities

• Implement real-time and near real-time data ingestion processes.
• Write and optimize code for large-scale data processing.
• Develop batch and streaming data solutions using Big Data technologies.
• Collaborate within Agile/Scrum methodologies to deliver engineering tasks.

Required Skills

• 8+ years of experience in data engineering or related roles.
• Hands-on experience with Apache Spark, preferably using Scala.
• Proficiency in Java, Scala, or Python.
• Experience with Hadoop ecosystems.
• Experience with Kafka for stream processing.
• Knowledge of real-time data ingestion patterns.
• Familiarity with Agile/Scrum workflows.

Preferred Skills

• Bachelor's degree or equivalent graduate level education.

Key Skills

Education

Any Gradute