Description

Design, build, and optimize large-scale data processing systems for business applications and analytics.

This role is on-site.

Responsibilities

• Design and develop data ingestion, processing, and transformation pipelines using the Hadoop ecosystem.
• Build and optimize distributed data processing applications using Apache Spark Core, SQL, and Streaming.
• Develop scalable solutions for both structured and unstructured data.
• Implement performance tuning, data security, and data governance best practices.
• Troubleshoot and resolve issues within Hadoop clusters, Spark jobs, and data pipelines.

Required Skills

• 8+ years of experience in Big Data and the Hadoop ecosystem.
• Expertise in Apache Spark (Core, SQL, Streaming) for batch and real-time processing.
• Hands-on experience with HDFS, Hive, HBase, Sqoop, Oozie, Flume, and YARN.
• Proficiency in Java, Scala, or Python.
• Experience working within Agile/Scrum development cycles.
• Ability to collaborate with architects and analysts to deliver technical solutions.

Preferred Skills

• Experience with data governance and security best practices.

Key Skills

Education

Any Gradute