Description

You will design and implement distributed data processing pipelines within a Big Data/Lakehouse ecosystem to support AI and ML workflows.

This role is on-site.

Responsibilities

• Architect data solutions using Spark and Python.
• Build and maintain data structures within AWS or Azure environments.
• Design distributed data processing pipelines for Big Data ecosystems.
• Support AI and ML workflows through robust data infrastructure.
• Own the end-to-end design and implementation of data systems.

Required Skills

• 8 to 10+ years of experience in data engineering.
• Proficiency with Spark and Python.
• Strong SQL skills.
• Experience with AWS or Azure cloud platforms.
• Proven experience in AI and ML implementation.
• Expertise in designing and architecting data systems.
• Hands-on experience with Big Data technologies.

Preferred Skills

• Degree in a graduate field.

Key Skills

Education

Any Graduate