Description

Build and maintain distributed, scalable data pipelines for real-time ingestion and processing using Spark and Scala. You will model business logic, harmonize raw data into curated views, and deploy production-ready applications through standard engineering practices.

This role is on-site.

Responsibilities

• Design, develop, test, and deploy scalable data applications in production.
• Build real-time data pipelines that ingest and process data at scale.
• Harmonize and transform raw data into consumable, curated views.
• Troubleshoot complex application issues through debugging and code review.
• Mentor others and contribute to maturing Data Engineering practices.

Required Skills

• 5+ years of experience with Spark and Scala.
• Proven track record building distributed, scalable data pipelines.
• Experience with real-time data ingestion and processing.
• Strong skills in modeling, coding, testing, and debugging complex applications.
• Ability to apply business logic within data processing frameworks.
• Experience documenting and maintaining production-grade code.

Preferred Skills

• Experience mentoring junior engineers or leading technical training.
• Background in establishing or improving Data Engineering best practices.

Key Skills

Education

Any Graduate