Description

You will design, develop, and maintain large-scale data processing solutions using the Hadoop ecosystem.

This role is remote.

Responsibilities

• Develop ETL workflows and data processing scripts using Apache Pig.
• Create, schedule, and manage complex workflows using Apache Oozie.
• Optimize Hadoop jobs for performance, scalability, and reliability.
• Write and troubleshoot complex HiveQL queries for data analysis.
• Troubleshoot production issues and maintain documentation for data pipelines.

Required Skills

• 5+ years of experience in Hadoop ecosystem development.
• Strong hands-on experience with Apache Hadoop (HDFS, MapReduce, YARN).
• Proficiency in Apache Pig for data processing and ETL.
• Experience with Apache Oozie for workflow scheduling and orchestration.
• Strong knowledge of Hive and writing complex HiveQL queries.
• Experience with SQL and data analysis.
• Familiarity with Linux/Unix environments and shell scripting.

Preferred Skills

• Knowledge of Apache Spark.
• Exposure to cloud platforms such as AWS, Azure, or GCP.
• Knowledge of Kafka, Sqoop, or Flume.

Key Skills

Education

Any Gradute