Description

You will design and develop automated test scripts and frameworks for data platforms.

Responsibilities

• Develop automation through Unix shell scripts and optimize them to improve system efficiency.
• Conduct data quality and performance testing within the Hadoop platform to ensure data integrity.
• Diagnose and fix system issues using shell scripts.
• Execute regression testing to maintain Hadoop platform stability across releases in an Agile framework.
• Document system changes and updates for future reference.

Required Skills

• 7+ years of experience as a Shell Developer or in a similar role.
• Proficiency in Unix shell scripting, including Bash, Perl, or Python.
• Strong knowledge of Linux/Unix operating systems.
• Solid understanding of the Hadoop ecosystem, including HDFS, MapReduce, Hive, Kafka, and Spark.
• Experience with Docker.
• Familiarity with version control systems and CI/CD pipelines.
• Any Graduate degree.

Key Skills

Education

Any Graduate