Description

Design, develop, and maintain large-scale data processing solutions and ETL pipelines within the Hadoop ecosystem.

This role is on-site.

Responsibilities

• Develop and optimize ETL workflows using Apache Pig scripts.
• Create, schedule, and manage complex data workflows using Apache Oozie.
• Design and maintain data processing solutions leveraging HDFS, MapReduce, and YARN.
• Write and optimize complex HiveQL queries for data analysis and storage.
• Troubleshoot production issues and ensure reliability of distributed data pipelines.

Required Skills

• 5+ years of experience in Hadoop ecosystem development.
• Strong hands-on proficiency with Apache Hadoop (HDFS, MapReduce, YARN).
• Expertise in Apache Pig for data processing and ETL development.
• Experience with Apache Oozie for workflow scheduling and orchestration.
• Strong knowledge of Hive and complex HiveQL query writing.
• Proficiency in SQL and data analysis.
• Familiarity with Linux/Unix environments and shell scripting.

Preferred Skills

• Experience with Apache Spark.
• Exposure to cloud platforms such as AWS, Azure, or GCP.

Key Skills

Education

Bachelors Degree