Description

You will build and maintain data processing pipelines in a Linux-based Hadoop ecosystem.

This role is on-site.

Responsibilities

• Build and optimize data processing workflows using Scala and Spark.
• Manage data storage and retrieval within Hive, HDFS, and HQL.
• Design process flow diagrams, business models, and functional designs.
• Solve complex technical problems through analytical and process-based methodologies.
• Deliver technical objectives within established project timelines.

Required Skills

• 5+ years of experience in Big Data development.
• Proficiency with Spark and Scala.
• Hands-on experience with the Hadoop ecosystem, including HDFS, Hive, and HQL.
• Experience working in Linux environments.
• Familiarity with Impala and HBase.
• Strong analytical skills for functional design and business modelling.
• Degree in any graduate field.

Preferred Skills

• Experience with real-time data processing using Spark Streaming.

Key Skills

Education

Any Graduate