Description

You will build and maintain data pipelines to ingest, process, and analyze large-scale datasets for downstream analytics and machine learning.

This role is on-site.

Responsibilities

• Develop and maintain batch and real-time processing systems.
• Cleanse, validate, and process data to ensure integrity for downstream analysis.
• Collaborate with data science and IT teams to implement analytics pipelines.
• Define data governance policies and support versioning and security processes.
• Design and test system applications including technical specifications.

Required Skills

• 6+ years of software development experience leading engineering teams.
• 5+ years hands-on experience with Informatica and Oracle.
• Expertise in Hadoop and Spark ecosystems, including architecture.
• Proficiency in Core Java, Python, or Scala.
• Advanced SQL skills for complex Hive or PySpark data frames and join optimization.
• Experience with UNIX shell scripting.
• Strong understanding of data warehousing concepts and distributed ecosystems.
• Bachelor's Degree in Engineering, Computer Science, or equivalent.

Preferred Skills

• 5+ years of experience in Data Engineering or Data Warehousing using Big Data technologies.
• Knowledge of the Financial reporting ecosystem.

Key Skills

Education

Bachelor's Degree