Description

You will build, optimize, and maintain data processing pipelines using big data frameworks.

This role is hybrid.

Responsibilities

• Migrate and refactor existing Java-based Spark modules to Scala, ensuring performance and scalability.
• Design, develop, test, and productionize new Scala Spark modules independently.
• Build backend services using Spring Boot and RESTful APIs.
• Optimize data processing pipelines within the Hadoop ecosystem.

Required Skills

• 8+ years of professional software engineering experience.
• Expert proficiency in Scala and Java.
• Hands-on experience with Apache Spark for distributed data processing.
• Experience with Hadoop ecosystem components: HDFS, Hive, and YARN.
• Proficiency with Microsoft SQL Server (MSSQL).
• Experience building backend services using Spring Boot.
• Experience developing RESTful APIs.

Preferred Skills

• Familiarity with Azure or AWS cloud migration.
• Familiarity with Machine Learning concepts.

Key Skills

Education

Any Graduate