Description

You will design, build, and maintain large-scale data systems and cloud platforms.

This role is hybrid.

Responsibilities

• Develop and maintain Hadoop systems and cloud platforms for application development.
• Load disparate datasets and perform pre-processing using Hive or Pig.
• Collaborate with R&D teams to deliver end-to-end Big Data solutions.
• Maintain production systems and manage communications between internal systems and vendors.
• Train staff on data resource management.

Required Skills

• 5+ years of experience as a Big Data Engineer.
• In-depth knowledge of Hadoop, PySpark, Spark, and Python.
• Hands-on experience with HDFS, Hive, and Pig.
• Proficiency with Kafka.
• Experience with NoSQL and RDBMS databases, specifically Redis and MongoDB.
• Background working within the banking sector.
• Ability to solve complex networking, data, and software issues.
• Strong project management and communication skills.

Preferred Skills

• Experience managing large-scale data resource workflows.

Key Skills

Education

Any Graduate