Description

You will design and develop ETL scripts using HDFS-based solutions and Hive QL to generate reports.

Responsibilities

• Develop Sqoop jobs to import and export data from Hadoop.
• Write Shell and Python scripts to automate data processes.
• Set up Hive structures and migrate them between environments.
• Troubleshoot Hive, Impala, Spark, and Sqoop issues for users.
• Monitor Hadoop cluster performance and tune MapReduce routines against large datasets.
• Manage Linux and Hadoop log files and perform HDFS maintenance.
• Collaborate with infrastructure, database, and analytics teams to ensure data quality.

Required Skills

• 5+ years of experience in ETL development.
• Proficiency with Hive, Spark, and MapReduce.
• Hands-on experience with HBase and Sqoop.
• Strong SQL and RDBMS utility skills.
• Ability to write Shell scripts and Python for automation.
• Experience with Eclipse, XML, and JSON.
• Knowledge of HDFS file system management.
• Any Graduate degree.

Key Skills

Education

Any Graduate