Description

You will architect and deliver large-scale data platforms using Azure and Databricks.

Responsibilities

• Architect and implement Azure data solutions using Databricks, Data Factory, Synapse Analytics, and Data Lake services.
• Design, build, and optimize a Medallion architecture (Bronze, Silver, Gold) for HR and enterprise data domains.
• Develop data pipelines, APIs, and orchestration frameworks for seamless data ingestion and delivery.
• Establish and maintain data governance, metadata, and lineage frameworks using Unity Catalog and Azure Purview.
• Serve as the technical authority for Azure and Databricks architecture, defining the data and AI modernization roadmap.

Required Skills

• 12+ years of hands-on experience architecting data platforms on Azure/Databricks.
• Expertise in Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.
• Proficiency in Python, SQL, PySpark, and Spark optimization.
• Experience developing ETL frameworks, data APIs, and real-time workflows.
• Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform, Bicep, Azure DevOps).
• Knowledge of Databricks MLflow, Agent Framework, and Delta Lake.
• Experience with data governance, security, and compliance best practices.
• Competency in GraphQL and API development.

Preferred Skills

• Bachelor's degree in a related technical field.

Key Skills

Education

Bachelor's degree