Description

You will migrate legacy ETL processes to a Spark-based processing framework within the data analytics team.

Responsibilities

• Migrate legacy ETL pipelines to Spark-based processing frameworks.
• Develop data processing logic using Java, Scala, or Python.
• Build and maintain data workflows within the Hadoop ecosystem.
• Support data analytics infrastructure and processing requirements.

Required Skills

• 5+ years of professional experience in data engineering.
• Strong core Java programming skills focused on data processing.
• Proficiency in Scala or Python.
• Hands-on experience with Hadoop and Spark.
• Experience with ETL development and implementation.
• Bachelor's degree or equivalent graduate qualification.

Preferred Skills

• Experience with AWS cloud services.
• Knowledge of Kafka, Unix, and Python.

Key Skills

Education

Any Gradute