Description

You will administer and maintain Hadoop clusters, ensuring high availability and performance for big data workloads.

This role is on-site.

Responsibilities

• Administer and maintain Hadoop clusters, ensuring high availability and performance.
• Develop and implement data processing workflows using PySpark.
• Monitor system performance and troubleshoot issues as they arise.
• Write and maintain shell scripts for automation of routine tasks.
• Collaborate with data engineers to optimize data storage and retrieval.

Required Skills

• Strong expertise in administering Hadoop clusters and related ecosystem components.
• Proficiency in Python and PySpark for developing and optimizing data workflows.
• Hands-on experience with Linux/UNIX systems and shell scripting for automation.
• Knowledge of Big Data concepts and tools (HDFS, Hive, HBase, Spark).
• Ability to monitor, troubleshoot, and optimize system performance.
• Understanding of data security, compliance, and governance best practices.

Preferred Skills

• Relevant degree in Computer Science or related field.

Key Skills

Education

Any Graduate