Description

Design, build, and support Hadoop ecosystems to process large-scale datasets.

Responsibilities

• Develop and maintain Flink applications using Java or Scala.
• Transform data using Spark and Scala to uncover insights from vast data stores.
• Design, manage, and deploy HBase instances.
• Create scalable web services for data tracking and implement high-speed querying.
• Translate complex functional and technical requirements into detailed designs.

Required Skills

• 5+ years of experience in Hadoop development and implementation.
• Proficiency with Spark and Scala for data transformation.
• Experience using IntelliJ IDEA, AutoSys, WinSCP, Putty, and GitHub.
• Ability to load and manage data from disparate datasets.
• Experience maintaining security and data privacy standards.
• Proven track record of testing prototypes and overseeing handover to operational teams.

Preferred Skills

• Knowledge of Teradata.

Key Skills

Education

Any Graduate