Description

You will design and implement a cloud-native data platform for compliance analytics, owning the end-to-end ETL workflows for sensitive financial datasets.

This role is on-site.

Responsibilities

• Build and optimize ETL pipelines using Azure Data Factory and Databricks for data ingestion and transformation.
• Integrate and normalize structured and unstructured data, ensuring strict adherence to data quality governance.
• Automate ingestion processes to enable real-time compliance analytics and reporting.
• Maintain comprehensive data lineage, metadata, and audit trails using Azure Purview or custom frameworks.
• Develop secure, auditable pipelines for sensitive financial datasets.

Required Skills

• 10+ years of experience in data engineering.
• 5+ years of experience in financial services, preferably compliance or regulatory domains.
• Advanced proficiency in SQL and Python.
• Hands-on experience with Azure Data Factory, Databricks notebooks, and ADLS.
• Expertise in data wrangling, modeling, and analytics enablement for compliance use cases.
• Experience integrating Microsoft ADF and Databricks for complex ETL development.
• Familiarity with data governance, quality frameworks, and audit processes.
• Experience with Git/GitLab and CI/CD tools such as Azure DevOps.

Preferred Skills

• Experience with Delta Lake for optimized storage and performance.

Key Skills

Education

Any Graduate