Description

Key Skills: Azure, Azure Databricks, Azure SQL, Azure Data lake, Azure Key Vault, Azure Synapse, Azure ADF, Azure Cloud

Roles and Responsibilities:

• Design and implement end-to-end data pipelines using Azure services for ingestion, transformation, and data delivery.
• Build and manage ETL/ELT workflows using Azure Data Factory (ADF), including orchestration and scheduling.
• Develop scalable data processing solutions using Azure Databricks with Spark SQL and PySpark.
• Implement and optimize data storage on Azure Data Lake Storage (ADLS Gen2) and manage data lifecycle patterns.
• Design and maintain data warehouses and analytics-ready datasets using Azure Synapse Analytics and Azure SQL Database.

Skills Required:

• 7-13 years of experience in data engineering, building and operating production data pipelines on Azure.
• Azure Data Factory (ADF) for pipeline orchestration and ETL/ELT workflow development.
• Azure Databricks for scalable Spark-based transformations and data processing.
• Azure Data Lake Storage (ADLS Gen2) for secure, optimized data storage and access patterns.
• Azure Synapse Analytics and Azure SQL Database for warehouse design and SQL-based data modeling.
• Azure Key Vault for secrets management and secure integration patterns.

Good to Have:

• Azure Monitor and Log Analytics for monitoring, troubleshooting, and operational visibility.
• Azure Functions for event-driven or lightweight processing components.

Education: Bachelor's Degree in Computer Science or related field; Master's Degree in Computer Science preferred

Key Skills

Education

Any Graduate