Description

Manage and optimize large-scale production clusters for data processing in a multi-tenant environment.

Responsibilities

• Manage and optimize production clusters including Hadoop and Spark.
• Develop and automate workflows to improve cluster efficiency.
• Write and maintain Python scripts for data operations.
• Operate within large-scale, multi-tenant production environments.

Required Skills

• 5+ years of hands-on experience with Spark.
• Experience managing production clusters with 1000+ instances.
• Proficiency in Python for development and scripting.
• Direct experience with Hadoop ecosystems.
• Ability to work in large-scale, multi-tenant environments.
• Any Graduate degree.

Key Skills

Education

Any Graduate