Description

Design and implement scalable big data solutions within a Linux-based Hadoop environment.

This role is on-site.

Responsibilities

• Design and implement scalable solutions using Spark, Scala, and Hadoop-based tools.
• Develop real-time data processing pipelines leveraging Spark Streaming.
• Manage data storage, querying, and transformation using Hive and SQL.
• Optimize processing workflows and ensure accurate data integration across distributed environments.
• Create detailed technical documentation, including process flow diagrams and functional designs.

Required Skills

• 5+ years of experience in big data engineering.
• Expertise in Apache Spark.
• Proficiency in Scala.
• Strong command of Hive and SQL.
• Experience with the Hadoop ecosystem, including HDFS, Impala, and HBase.
• Working proficiency in Linux-based environments.
• Ability to produce functional designs and process flow diagrams.

Preferred Skills

• Experience in the Banking or Capital Markets domain.
• Hands-on experience with Spark Streaming for real-time analytics.

Key Skills

Education

Any Gradute