Description

You will design, build, and maintain data pipelines for ingesting, storing, and processing large-scale datasets.

This role is on-site.

Responsibilities

• Develop and maintain data pipelines for batch and real-time processing.
• Implement analytics pipelines in collaboration with data science teams.
• Process, cleanse, and validate data integrity for analysis and machine learning.
• Analyze large data stores to uncover patterns and propose technical solutions.
• Document technical specifications and analyze system processing flows.

Required Skills

• 5–7 years of experience in software development and data engineering.
• Expertise in Hadoop and Spark architecture and working principles.
• Hands-on experience with Big Data, Spark, and Hadoop technologies.
• Proficiency in Python, Scala, or Core Java.
• Strong SQL skills, including complex queries (Hive/PySpark DataFrames) and join optimization.
• Experience with Informatica and Oracle.
• Solid understanding of Data Warehousing concepts.
• Proficiency in Unix shell scripting.
• Bachelor of Computer Science or equivalent degree.

Preferred Skills

• K knowledge of the Financial reporting ecosystem.

Key Skills

Education

BACHELOR OF COMPUTER SCIENCE