Description

You will own data processing logic and pipeline development from technical design through execution.

This role is on-site.

Responsibilities

• Develop and maintain data processing logic using Python and PySpark.
• Implement and support data pipelines on AWS Glue.
• Manage data workflows within an Agile project environment.
• Own assigned tasks from technical design through to execution.
• Collaborate with the team to ensure timely delivery of data solutions.

Required Skills

• 5+ years of professional experience in software or data engineering.
• Strong proficiency in Python.
• Extensive experience with PySpark for data processing.
• Hands-on experience with AWS, specifically AWS Glue.
• Experience working within Agile methodologies.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Experience with Airflow, CloudFormation, or Jenkins.

Key Skills

Education

Any Graduate