Description

You will develop and maintain applications leveraging Apache Spark and Java.

Responsibilities

• Work on performance improvements for Spark applications processing millions of data elements daily.
• Implement software solutions by collaborating with business analysts and lead engineers to define requirements.
• Manage production support and troubleshooting for Spark applications to identify issues.
• Develop and maintain applications using the Spark ecosystem, including Datasets and Spark SQL.
• Contribute to software engineering communities of practice focused on new technologies.

Required Skills

• 3+ years applied experience in a Data Engineering domain.
• Proficiency in coding using Java.
• Hands-on experience with system design, application development, testing, and operational stability.
• Experience developing, debugging, and maintaining code in a corporate environment using Java and the Spark Framework.
• Working knowledge of database querying languages (any SQL experience).
• Understanding of the Software Development Life Cycle.
• Experience operating within an Agile Software Development Environment.
• Familiarity with ETL processes.

Preferred Skills

• Exposure to cloud technologies like AWS.
• Familiarity with Kafka.

Key Skills

Education

Any Gradute