Description

Manage large-scale data sets within a data lake environment, tuning Spark performance for optimized data processing.

This role is on-site.

Responsibilities

• Manage large data sets within a data lake environment.
• Tune Spark performance to optimize data processing.
• Collaborate with business and technical stakeholders independently.
• Articulate data insights and technical requirements to business stakeholders.

Required Skills

• 10+ years of experience in data management.
• 5+ years of experience working with large data sets in a data lake environment.
• Highly proficient in SQL.
• Solid understanding of Spark, including performance tuning.
• Experience with the AWS platform.
• Proficiency in Python.
• Ability to work with minimal guidance.
• Strong written and verbal communication skills.

Preferred Skills

• Any graduate degree.

Key Skills

Education

ANY GRADUATE