Description

You will build and maintain data processing pipelines within the Hadoop ecosystem.

This role is remote.

Responsibilities

• Develop and optimize data processing tasks using Spark and Hadoop components.
• Write and maintain scripts using Shell, Java, Scala, or Python.
• Execute data queries using HiveQL and SparkQL.
• Manage data workflows using engines like Oozie or Autosys.
• Support migration projects on Hadoop platforms.

Required Skills

• Hands-on experience with Spark and the Hadoop ecosystem.
• Practical experience with Cloud platforms such as AWS or GCP.
• Proficiency in HiveQL and SparkQL.
• Strong programming skills in Java, Scala, or Python.
• Experience writing Shell scripts.
• Degree in any graduate field.

Preferred Skills

• Knowledge of SQL.
• Experience with Agile development methodologies.
• Background in automation approaches.

Key Skills

Education

Any graduate