Description

Design and implement large-scale data processing pipelines using distributed computing frameworks, owning the release and maintenance of real-time data applications.

This role is on-site.

Responsibilities

• Build and maintain real-time data processing applications using Spark Streaming.
• Develop scalable data pipelines within AWS or GCP environments.
• Write and optimize high-performance code using Scala.
• Manage end-to-end data workflows to ensure processing efficiency.

Required Skills

• 7+ years of experience in big data engineering.
• Extensive experience with Spark and Spark Streaming.
• Strong proficiency in Scala.
• Hands-on experience with AWS or GCP.
• Bachelor's degree or equivalent graduate qualification.

Preferred Skills

• Professional experience working with Java.
• Professional experience working with Python.

Key Skills

Education

Any Graduate