Description

You will develop and maintain big data solutions using Hadoop technologies, focusing on ETL pipelines and data archival.

This role is on-site.

Responsibilities

• Maintain and develop components using Apache NiFi and Kafka message broker systems.
• Develop, analyze, and maintain ETL jobs according to organizational standards using Sqoop.
• Schedule, monitor, and administer large-volume ETL processes.
• Interact with stakeholders to manage the archival of old data.
• Troubleshoot code and collaborate with Architects, BAs, and Data Analysts.

Required Skills

• 5+ years of experience in Big Data development.
• Expertise with Kafka and Apache NiFi.
• Experience with HortonWorks platform and Sqoop for ETL jobs.
• Knowledge of ETL processes on Big Data Hadoop platforms.
• Proficiency with SQL and database systems (Oracle, Sybase).
• Experience with Azure Data Lake and data warehousing concepts.
• Familiarity with Tableau for big data analytics.
• Knowledge of Big Data platform administration.

Key Skills

Education

Any Graduate