Description

You design and implement scalable regulatory reporting models and data pipelines using Apache Spark and Scala on AWS.

This role is on-site.

Responsibilities

• Build and optimize data pipelines for large volumes of financial data to meet regulatory requirements.
• Develop production-grade data models in collaboration with risk, finance, and compliance teams.
• Leverage AWS services including S3, EMR/Glue, and Lambda for efficient and secure data solutions.
• Perform performance tuning, code quality reviews, and ensure high availability of critical reporting systems.
• Create test cases, document data processes, and manage deployments using Jenkins and Control-M.

Required Skills

• 10+ years of experience in Big Data and Hadoop ecosystems.
• Solid experience with Apache Spark and Scala for data processing.
• Advanced SQL skills with ability to replicate functionality and test changes thoroughly.
• Hands-on experience with AWS services (S3, EMR/Glue, Lambda).
• Proficiency with Git, Maven, and Unix/Linux environments.
• Experience with DevOps tools including Jenkins, Jira, and Control-M.
• Background in Financial Services or Banking with understanding of regulatory reporting.

Preferred Skills

• Familiarity with GenAI tools and their application in data engineering workflows.
• Ability to translate complex regulatory rules into technical specifications for non-technical partners.

Key Skills

Education

Any Graduate