Description

You design, build, and maintain scalable data pipelines and lakehouse architectures on Azure.

This role is on-site.

Responsibilities

• Design and deploy scalable data pipelines using Databricks and Azure Data Factory.
• Implement ETL/ELT processes to ingest, transform, and load data into data lakes and warehouses.
• Write and optimize complex SQL queries and PySpark jobs for performance and scalability.
• Integrate structured, semi-structured, and unstructured data sources with batch and streaming patterns.
• Apply data governance, ensure data integrity, and troubleshoot pipeline availability.

Required Skills

• 5+ years of data engineering experience.
• Hands-on Databricks expertise: PySpark, Serverless SQL, Unity Catalog, Lakehouse, and Medallion Architecture.
• Proficiency with Azure Data Factory, Azure Data Lake Storage, and Azure SQL Database.
• Strong SQL optimization skills.
• Experience implementing ETL/ELT workflows and data modeling best practices.
• Knowledge of Azure Key Vault for governance and security.

Preferred Skills

• Azure DevOps for CI/CD and operational support of data pipelines.

Key Skills

Education

Any Graduate