Description

You will own the design and implementation of a cloud-native data platform for compliance analytics.

Responsibilities

• Own the design and implementation of ETL workflows using Azure Data Factory and Databricks for data ingestion and transformation.
• Integrate and normalize data from structured and unstructured sources, ensuring adherence to data quality governance.
• Develop secure, auditable, and optimized pipelines for sensitive financial datasets.
• Automate ingestion and transformation processes to enable real-time compliance analytics and reporting.
• Maintain comprehensive data lineage, metadata, and audit trails using Azure Purview or custom frameworks.

Required Skills

• 10+ years of experience in data engineering.
• 5+ years of experience in financial services, preferably compliance/regulatory.
• Advanced proficiency in SQL and Python.
• Hands-on experience with Azure Data Factory, Databricks notebooks, and ADLS.
• Expertise in data wrangling, modeling, and analytics enablement for compliance use cases.
• Experience integrating Microsoft ADF and Databricks for complex ETL development.
• Familiarity with data governance, quality frameworks, and audit processes.
• Experience with Git/GitLab and CI/CD tools such as Azure DevOps.

Key Skills

Education

Any Graduate