Description

Design and implement high-throughput data architectures and real-time streaming pipelines for retail banking systems.

This role is on-site.

Responsibilities

• Build operational data stores (ODS) to capture cross-system transactions with low latency.
• Develop real-time and near real-time data streaming pipelines using event-based architectures.
• Create configuration-based data pipelines to ensure reusable and scalable code.
• Model Party Data structures specific to retail banking requirements.
• Automate Azure platform engineering tasks using cloud automation frameworks and CI/CD tools.

Required Skills

• 5+ years of experience implementing ODS using RDBMS or NoSQL technologies.
• Hands-on experience with Spark and Confluent Kafka for real-time streaming.
• Proficiency with Azure Data Lake Storage (ADLS) Gen2 and Azure Blob storage.
• Experience using Azure Databricks, Azure SQL Server, and Azure Redis Cache.
• Expertise in Azure platform engineering using PowerShell, ARM Templates, Azure DevOps, and GitLab.
• Practical knowledge of metadata management, including Data Governance, Data Quality, MDM, Lineage, and Data Catalog.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree