Description

You will work as an individual contributor focusing on data processing and pipeline development.

Responsibilities

• Own assigned tasks from technical design through to execution.
• Develop and maintain data processing logic using Python and PySpark.
• Manage data workflows within an Agile project environment.
• Implement and support data pipelines on AWS Glue.

Required Skills

• 5+ years of professional experience in software or data engineering.
• Strong proficiency in Python.
• Extensive experience with PySpark.
• Hands-on experience with AWS, specifically AWS Glue.
• Experience working within Agile methodologies.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Experience with Airflow, CloudFormation, or Jenkins.

Key Skills

Education

Any Graduate