Description

Role: Hadoop Developer (Pig & Oozie)

Location: Remote

Duration: Long Term (12+ Months)

Required Skills

• 5+ years of experience in Hadoop ecosystem development.
• Strong hands-on experience with Apache Hadoop (HDFS, MapReduce, YARN).
• Proficiency in Apache Pig for data processing and ETL development.
• Experience with Apache Oozie for workflow scheduling and orchestration.
• Strong knowledge of Hive and writing complex HiveQL queries.
• Good understanding of HDFS and distributed data storage.
• Experience with SQL and data analysis.
• Familiarity with Linux/Unix environments and shell scripting.
• Knowledge of Spark is a plus.
• Experience working with large-scale data pipelines and ETL processes.
• Strong problem-solving and debugging skills.
• Excellent communication and collaboration skills.

Responsibilities

• Design, develop, and maintain data processing solutions using the Hadoop ecosystem.
• Develop ETL workflows using Pig scripts.
• Create, schedule, and manage workflows using Oozie.
• Optimize Hadoop jobs for performance and scalability.
• Work closely with data engineers, analysts, and cross-functional teams.
• Troubleshoot production issues and ensure data pipeline reliability.
• Maintain documentation and follow coding best practices.

Preferred Qualifications

• Experience working in enterprise big data environments.
• Exposure to cloud platforms such as AWS, Azure, or GCP is a plus.
• Knowledge of Kafka, Sqoop, or Flume is an added advantage.
• Experience with Agile/Scrum methodologies.

Thanks and Regards, 

Arjun Singh

Technical Recruiter

Technocraft Solutions LLC

Email: arjun@technocraftsol.com

Key Skills

Education

Bachelors Degree