Description

Develop and maintain data processing workflows within a Hadoop ecosystem.

Responsibilities

• Build and optimize data pipelines using Spark, Scala, and MapReduce.
• Manage data storage and retrieval using HDFS, Hive, and Pig.
• Implement and manage NoSQL databases including Cassandra and MongoDB.
• Automate workflows using Oozie and UNIX shell scripting.
• Develop data solutions within Hortonworks, MapR, or IBM Big Insights environments.

Required Skills

• 5+ years of experience in big data development.
• Proficiency in Spark and Scala.
• Strong experience with Hive, Pig, and Oozie.
• Hands-on expertise with HDFS and MapReduce.
• Experience with NoSQL technologies like Cassandra and MongoDB.
• Core Java programming skills.
• UNIX shell scripting or PL/SQL proficiency.

Preferred Skills

• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree