Description

Key Responsibilities

Design, develop, and maintain scalable data solutions on Microsoft Azure

Build and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks

Develop and manage enterprise data lake solutions using Azure Data Lake Storage (ADLS)

Implement Spark-based data processing solutions for large-scale datasets

Create dashboards and reporting solutions using Power BI

Ensure data quality, governance, lineage, and compliance standards are maintained

Collaborate with cross-functional teams including analytics, engineering, and business stakeholders

Optimize SQL queries, data models, and overall pipeline performance

Implement secure cloud data architectures and Azure security best practices

Required Qualifications

Strong hands-on experience with Azure Data Factory (ADF)

Expertise in Azure Databricks and Apache Spark

Experience with Azure Data Lake, Power BI, and SQL

Advanced SQL development and query optimization skills

Experience designing scalable ETL/ELT pipelines

Strong understanding of Azure security concepts including IAM, RBAC, encryption, and secure data communication

Experience with data governance, metadata management, and data lineage

Databricks Certified Data Engineer Associate certification

Preferred Qualifications

Experience with Azure Synapse Analytics, Azure Cosmos DB, or Azure Machine Learning

Knowledge of serverless Azure architecture

Experience with .NET / C# is a plus

Azure certifications such as Azure Security Engineer Associate or Azure Solutions Architect Expert preferred

Prior experience in enterprise or regulated industry environments is a plus

Key Skills

Education

Bachelor's degree