Description

Build and maintain data pipelines using distributed computing and cloud-native ETL tools.

This role is hybrid.

Responsibilities

• Develop and optimize ETL processes to move data through the pipeline.
• Build scalable data processing jobs using PySpark.
• Manage data workloads within AWS environments.
• Maintain data integrity and processing efficiency across distributed systems.

Required Skills

• Proficiency in Python.
• Strong experience with PySpark.
• Hands-on experience with AWS Glue.
• Experience using AWS EMR.
• Solid understanding of ETL workflows.
• Minimum of 1 year of professional experience.

Preferred Skills

• Bachelor's degree or equivalent graduate qualification.

Key Skills

Education

Any Graduate