Description

Maintain and optimize Hadoop ecosystems for large-scale data processing.

This role is remote.

Responsibilities

• Maintain Hadoop environments across versions 2.6.4 and 3.1.5.
• Develop data processing workflows using Spark and Hive SQL.
• Write and optimize automation scripts using Python and shell scripting.
• Manage and monitor data pipelines within the Hortonworks ecosystem.

Required Skills

• 5+ years of experience in data engineering roles.
• Hands-on experience with Hadoop 2.6.4.
• Hands-on experience with Hadoop 3.1.5.
• Proficiency in Hive SQL.
• Experience with Spark 2.0.
• Proficiency in Python 3.5.
• Working knowledge of shell scripting.

Preferred Skills

• Bachelor's degree or equivalent graduate qualification.

Key Skills

Education

Any Gradute