Description

You will design and develop HDFS-based solutions using Hive QL to generate reports. You own the data pipeline integrity, from ingestion to analysis.

Responsibilities

• Write Sqoop jobs to import and export data from Hadoop.
• Develop automation scripts using Shell and Python.
• Set up Hive structures and migrate them between environments.
• Monitor Hadoop cluster job performance and tune MapReduce routines against large datasets.
• Troubleshoot Hive, Impala, Spark, and Sqoop issues for users.

Required Skills

• 5+ years of experience in Hadoop development.
• Proficiency with MapReduce, Spark, Hive, and HBase.
• Strong SQL and RDBMS utility knowledge.
• Experience with Sqoop and Hive QL.
• Ability to use Eclipse, XML, and JSON.
• Hands-on experience with Linux environments.
• Experience managing HDFS support and maintenance.

Preferred Skills

• Experience collaborating with infrastructure, database, and business analytics teams to ensure data quality.

Key Skills

Education

Any Graduate