Description

You will design and manage large-scale data processing workflows within a Hadoop ecosystem.

Responsibilities

  • Develop and maintain data pipelines using Spark and Scala.
  • Write and optimize scripts in Python, Perl, and Shell to automate data tasks.
  • Manage real-time data streaming using Kafka.
  • Build and scale distributed data processing jobs on Hadoop clusters.

Required Skills

  • 12+ years of experience in data engineering.
  • Expertise in Hadoop ecosystems.
  • Proficiency in Spark and Scala.
  • Strong Python programming skills.
  • Experience with Kafka for stream processing.
  • Ability to write Shell scripts for automation.
  • Experience with Perl scripting.

Education

  • Bachelor's degree or equivalent graduate level education.

Key Skills
Education

Any Graduate

Back To Jobs