Description

You will build and manage data pipelines and Hadoop-based infrastructure.

This role is on-site.

Responsibilities

• Install and configure Hadoop clusters alongside Hive, Pig, Sqoop, HBase, and ZooKeeper.
• Develop ETL processes to load data into HDFS using Sqoop and export results back to RDBMS.
• Use Pig for data transformations, event joins, and pre-aggregations before HDFS sorting.
• Write MapReduce programs to cleanse data from heterogeneous sources for Hive schema analysis.

Required Skills

• 5+ years of professional experience.
• Deep expertise in the Hadoop ecosystem: Hive, Pig, Sqoop, HBase, and ZooKeeper.
• Proficiency in ETL development and HDFS management.
• Experience working with RDBMS and heterogeneous data sources.
• MapReduce programming for data cleansing and processing.
• Master's degree in Computer Science, IT, or a related field.

Key Skills

Education

Master's degree