Description

You will design, develop, and maintain ETL pipelines using Hadoop ecosystem tools to support reporting and data analytics needs.

Responsibilities

• Develop Sqoop jobs to import and export data between Hadoop and external systems.
• Write Shell and Python scripts to automate data processing workflows.
• Design Hive structures, manage environment migrations, and maintain HDFS file systems.
• Troubleshoot issues across Hive, Impala, Spark, and Sqoop for internal users.
• Monitor cluster performance, tune MapReduce routines, and manage Linux/Hadoop logs.

Required Skills

• 5+ years of experience in ETL development.
• Strong proficiency with Hive, Spark, and MapReduce.
• Hands-on experience with HBase and Sqoop.
• Advanced SQL and RDBMS utility skills.
• Ability to write automation scripts in Shell and Python.
• Experience with Eclipse, XML, and JSON data formats.
• Knowledge of HDFS file system management.

Preferred Skills

• Experience collaborating with infrastructure, database, and analytics teams to ensure data quality.

Key Skills

Education

Any Graduate