Description

Build and maintain distributed, scalable data pipelines for real-time ingestion and processing. You will model business logic and metrics using Spark and Scala, handling the full application lifecycle from design to deployment. Responsibilities include transforming raw data into curated views, debugging complex code, and contributing to data engineering best practices.

Responsibilities

• Design, develop, and deploy scalable data pipelines using Spark and Scala.
• Transform and harmonize raw data into consumable, curated views.
• Apply business logic and create metrics within the data processing layer.
• Troubleshoot, debug, and optimize complex application code.
• Mentor peers and contribute to maturing data engineering practices.

Required Skills

• 5+ years of professional experience in data engineering or software development.
• Strong proficiency in Apache Spark.
• Strong proficiency in Scala.
• Experience with distributed system design and real-time data processing.
• Ability to troubleshoot and debug complex application issues.
• Experience in writing, testing, and documenting production-grade code.

Key Skills

Education

Any Graduate