Description

Lead architecture and solution design for scalable Azure Databricks data platforms.

This role is on-site.

Responsibilities

• Translate business requirements into scalable Azure Databricks-based data architectures.
• Design end-to-end data platforms using Azure Databricks, ADLS, Delta Lake, and related Azure services.
• Define lakehouse architectures supporting batch, streaming, and near real-time use cases.
• Drive DevOps enablement, establishing monitoring, logging, and CI/CD pipelines using Azure DevOps and Git.
• Review and validate offshore team deliverables for architectural adherence and quality.

Required Skills

• 13+ years in data engineering or data architecture roles.
• 7+ years designing solutions specifically on Azure data platforms.
• 5+ years in a technical lead or solution architect capacity.
• Strong hands-on expertise with Azure Databricks (Spark, Delta Lake, Unity Catalog).
• Deep experience with Azure Data Lake Storage (ADLS Gen2) and Azure Data Factory/Synapse Pipelines.
• Proficiency in Python, SQL, and Spark optimization.
• Experience with streaming technologies like Event Hub or Kafka.
• Proven ability to manage distributed or offshore delivery teams while maintaining hands-on architectural rigor.

Key Skills

Education

Bachelor's degree