Description

You will develop and maintain big data pipelines within the Hadoop ecosystem.

This role is on-site.

Responsibilities

• Develop and maintain data pipelines using Scala and Spark.
• Manage and optimize data storage and retrieval across HBase, Solr, and Hive.
• Implement data processing workflows using Gremlin and Pig.
• Integrate big data components within the Hadoop ecosystem.

Required Skills

• 7+ years of experience in Hadoop development or big data engineering.
• In-depth knowledge of Scala and Spark.
• Hands-on experience with HBase, Solr, and Hive.
• Proficiency with Gremlin and Pig.
• Experience with Azure Databricks and Azure Data Factory (ADF).
• Degree in any graduate field.

Preferred Skills

• Experience with Flume or NiFi.
• Background as a data engineer on the Azure stack, specifically working with Synapse Analytics.

Key Skills

Education

Any Graduate