Description

You will develop and optimize data processing workflows within the Hadoop ecosystem.

Responsibilities

• Develop MapReduce programs and Hadoop streaming applications.
• Write Pig scripts and HiveQL to analyze structured, semi-structured, and unstructured data flows.
• Implement table definitions, file formats, and User Defined Functions (UDF).
• Manage data layout strategies including partitions and buckets.
• Optimize data processing through debugging and performance tuning.

Required Skills

• 5+ years of professional development experience.
• Deep expertise in the Hadoop ecosystem: Spark, Scala, Oozie, Pig, Hive, HDFS, and MapReduce.
• Experience with NoSQL technologies such as Cassandra or MongoDB.
• Hands-on experience with real-time and stream processing systems.
• Proficiency in Core Java, UNIX shell scripting, or PL/SQL stored procedures.
• Knowledge of Hadoop distributions including CDH 4/5, Hortonworks, MapR, or IBM Big Insights.
• Experience with Big Data components: YARN, Falcon, ZooKeeper, Sqoop, and Flume.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate