Description

Own the end-to-end architecture for Azure Databricks-based data platforms, from ingestion to governance.

This role is on-site.

Responsibilities

• Design reusable frameworks, ELT patterns, and data models to improve delivery speed and maintainability.
• Build and optimize Spark jobs and pipelines with a focus on performance, reliability, and cost efficiency.
• Architect solutions using Azure Databricks, Delta Lake, ADLS, and Azure Data Factory.
• Establish governance, security, and code-quality standards for the platform.
• Guide troubleshooting, code reviews, and production support for complex data workloads.

Required Skills

• 12+ years of experience in data engineering, data architecture, or platform engineering.
• Strong hands-on experience with Azure Databricks, Spark, Python, Scala, and SQL.
• Proven experience implementing cloud data hubs, data lakes, and analytical data stores.
• Experience with Delta Lake and ELT patterns.
• Proficiency in Azure DevOps, CI/CD, and automated deployment practices.
• Ability to work directly on technical implementation, not only provide oversight.
• Bachelor's degree in a related field.

Preferred Skills

• Experience in financial services or insurance.
• Knowledge of Event Hub, Cosmos DB, Azure Synapse, or other Azure analytics services.
• Databricks or Microsoft Azure certifications.

Key Skills

Education

Bachelor's degree