Description

Design and maintain data pipelines using AWS services and Python.

This role is hybrid.

Responsibilities

• Build and maintain data architectures and pipelines on AWS (S3, Lambda, EMR, Glue, Athena).
• Develop complex data solutions using Python, SQL, and Spark for big data processing.
• Implement Infrastructure as Code concepts and manage containers with Docker.
• Document technical standards, processes, and architecture specifications.
• Identify opportunities for continuous improvement in data analytics and technical methodologies.

Required Skills

• 5+ years of professional experience in data engineering or related IT roles.
• Proficiency in Python and SQL.
• Hands-on experience with AWS services: S3, Lambda, EMR, Glue, and Athena.
• Experience with Spark and big data processing frameworks.
• Familiarity with Docker and Infrastructure as Code.
• Proficiency with Git and Bitbucket for version control.
• Experience in data analytics.

Preferred Skills

• Experience with middleware or hardware project leadership.
• Knowledge of IT development methodologies and technical standards.

Key Skills

Education

Any Graduate