Description

You will design and implement distributed data processing pipelines within a Big Data/Lakehouse ecosystem.

Responsibilities

• Design and implement distributed data processing pipelines.
• Architect data solutions using Spark and Python.
• Build and maintain data structures within AWS or Azure environments.
• Leverage Big Data/Lakehouse ecosystems to support AI and ML workflows.

Required Skills

• 8 to 10+ years of experience in data engineering.
• Proven experience in AI and ML implementation.
• Proficiency with Spark and Python.
• Strong SQL skills.
• Experience with AWS or Azure cloud platforms.
• Expertise in designing and architecting data systems.
• Hands-on experience with Big Data technologies.
• Degree in any graduate field.

Key Skills

Education

Any Graduate