Description

Lead technical implementations within Big Data and Hadoop ecosystems, owning the architecture and optimization of large-scale data workflows.

This role is on-site.

Responsibilities

• Architect and manage data workflows using PySpark and Python.
• Maintain and optimize large-scale datasets within the Cloudera Data Platform.
• Develop and execute Unix shell scripts for automated text processing and system tasks.
• Oversee data querying and processing using Hive, MapReduce, and Impala.

Required Skills

• 10+ years of experience in data engineering or technical leadership roles.
• Expertise in Cloudera Data Platform and Big Data technologies.
• Proficiency in PySpark and Python.
• Strong command of Hive and MapReduce.
• Hands-on experience with Impala.
• Advanced Linux/Unix administration and shell scripting skills.
• Experience working with Cloud technologies.
• Background in Big Data and Hadoop ecosystems, including MapR.

Preferred Skills

• Experience leading technical teams in distributed systems.
• Deep understanding of data governance and security within Hadoop ecosystems.

Key Skills

Education

Any Graduate