Description

Develop and maintain Spark applications using Java, focusing on performance optimization and production stability.

This role is on-site.

Responsibilities

• Optimize Spark applications processing millions of data elements daily.
• Develop and maintain applications using Spark SQL and Datasets.
• Manage production support and troubleshoot application issues.
• Collaborate with business analysts and engineers to define requirements.
• Contribute to engineering communities of practice for new technologies.

Required Skills

• 3+ years of applied experience in Data Engineering.
• Proficiency in Java and Core Java.
• Hands-on experience with the Spark Framework.
• Knowledge of SQL and database querying.
• Experience with system design, testing, and operational stability.
• Familiarity with ETL processes and SDLC.
• Experience working in an Agile environment.

Preferred Skills

• Exposure to AWS cloud technologies.
• Familiarity with Kafka.

Key Skills

Education

Any Gradute