Description

Migrate legacy ETL processes to a Spark-based processing framework and maintain data workflows within the Hadoop ecosystem.

This role is on-site.

Responsibilities

• Migrate legacy ETL pipelines to Spark-based processing frameworks.
• Develop data processing logic using Java, Scala, or Python.
• Build and maintain data workflows within the Hadoop ecosystem.
• Support data analytics infrastructure and processing requirements.

Required Skills

• 5+ years of professional experience in data engineering.
• Strong core Java programming skills focused on data processing.
• Proficiency in Scala or Python.
• Hands-on experience with Hadoop and Spark.
• Experience with ETL development and implementation.
• Bachelor's degree or equivalent graduate qualification.

Preferred Skills

• Experience with AWS cloud services.
• Knowledge of Kafka and Unix.

Key Skills

Education

Any Gradute