Description

You design, develop, and maintain large-scale data processing solutions using the Hadoop ecosystem.

This role is remote.

Responsibilities

• Design and implement data pipelines and ETL processes using Apache Hadoop components.
• Optimize Hadoop jobs for performance and scalability in distributed environments.
• Troubleshoot production issues and ensure data pipeline reliability.
• Collaborate with data engineers and analysts to solve complex data problems.
• Maintain documentation and adhere to coding best practices.

Required Skills

• 5+ years of experience in Hadoop ecosystem development.
• Strong hands-on experience with Apache Hadoop (HDFS, MapReduce, YARN).
• Proficiency in writing complex HiveQL queries and knowledge of Hive.
• Experience with SQL and data analysis.
• Familiarity with Linux/Unix environments and shell scripting.
• Understanding of distributed data storage and large-scale data pipelines.

Preferred Skills

• Experience with Spark, Kafka, Sqoop, or Flume.
• Exposure to cloud platforms such as AWS, Azure, or GCP.
• Experience working in enterprise big data environments using Agile/Scrum.

Key Skills

Education

Any Gradute