Description

Lead architecture design and implementation for enterprise-scale modern data platforms on Azure.

This role is on-site.

Responsibilities

• Lead customer discussions and define architecture for large-scale data initiatives.
• Drive DataOps processes including CI/CD, observability, automation, testing, and data lineage.
• Define intake, triage, and support workflows for BAU operations and SLA management.
• Build reusable frameworks, runbooks, and modules to accelerate onboarding and delivery.
• Mentor engineers on architectural best practices, performance tuning, and vendor evaluations.

Required Skills

• 15+ years of experience in data engineering and architecture.
• Expertise in Azure Databricks, Delta Lake, Notebooks, Workflows, and Unity Catalog.
• Strong programming skills in Python, PySpark, and SQL.
• Experience with Azure Data Factory (ADF), Azure Purview, and Azure DevOps.
• Proficiency in building CI/CD pipelines and managing REST APIs.
• Knowledge of AIOps and MLOps practices.
• Bachelor's degree in a relevant field.

Preferred Skills

• Experience with Stored Procedures and data governance strategies.

Key Skills

Education

Bachelor's degree