Description

Build and maintain scalable data pipelines using distributed computing frameworks.

Responsibilities

• Develop batch and streaming data solutions using Big Data technologies.
• Implement real-time or near real-time data ingestion processes.
• Write and optimize code for large-scale data processing.
• Work within Agile/Scrum methodologies to deliver data engineering tasks.

Required Skills

• 8+ years of experience in data engineering or related roles.
• Hands-on experience with Spark, preferably using Scala.
• Proficiency in Java, Scala, or Python.
• Experience with Hadoop ecosystems.
• Experience with Kafka for stream processing.
• Knowledge of real-time data ingestion patterns.
• Familiarity with Agile/Scrum workflows.
• Bachelor's degree or equivalent graduate level education.

Key Skills

Education

Any Gradute