Description

You will design, develop, and maintain scalable data pipelines using Azure Data Factory, Synapse Analytics, Databricks, and Azure Data Lake Storage (ADLS). You will implement data ingestion, transformation, and integration processes from diverse on-premises and cloud-based sources.

Responsibilities

• Design and build end-to-end data pipelines using Azure Data Factory, Synapse Analytics, and Databricks.
• Configure and manage Azure resources including storage accounts, databases, and compute services.
• Develop and optimize SQL scripts, stored procedures, and views for data transformation and reporting.
• Ensure data quality, governance, and security using Azure Purview, Key Vault, and RBAC.
• Monitor, troubleshoot, and resolve pipeline failures and performance issues in production.

Required Skills

• Expertise in Azure Data Factory (ADF): pipelines, triggers, linked services, and data flows.
• Hands-on experience with Azure Synapse Analytics, SQL Data Warehouse, and advanced query optimization.
• Proficiency in Azure Databricks (Spark/PySpark) for large-scale data processing.
• Strong proficiency in SQL, T-SQL, query optimization, and performance tuning.
• Experience with ETL/ELT frameworks and data modeling (Star/Snowflake schema).
• Familiarity with Azure Data Lake Gen2 storage best practices.
• Knowledge of Azure SQL, Cosmos DB, and SQL Server.

Preferred Skills

• CI/CD implementation using Azure DevOps; familiarity with Git, ARM templates, or Terraform.
• Microsoft Certified: Azure Data Engineer Associate (DP-203) or equivalent.
• Exposure to Power BI integration.

Key Skills

Education

Any Graduate