Description

Lead the architecture and implementation of advanced analytics solutions on Azure Databricks and Fabric.

This role is on-site.

Responsibilities

• Design and build end-to-end data pipelines using Azure Databricks, PySpark, and Azure Data Factory.
• Integrate Azure Databricks with Azure Data Lake, Synapse, and on-premise systems.
• Manage cluster configurations, notebook development, and Delta Lake optimization.
• Define and enforce code quality, security, and governance standards for data engineering teams.
• Mentor data engineers and collaborate with stakeholders to translate business requirements into technical solutions.

Required Skills

• 10+ years of experience in data engineering and cloud computing.
• Expertise in Azure Databricks, including cluster management and Delta Live Tables.
• Strong proficiency in SQL and PySpark for big data processing.
• Hands-on experience with ETL/ELT processes and data warehousing concepts.
• Deep understanding of Azure services: Data Lake Storage Gen2, Synapse, and Data Factory.
• Experience with CI/CD pipelines and version control systems like Git.
• Familiarity with NoSQL databases and cloud security best practices.

Preferred Skills

• Experience with Microsoft Fabric for analytics and integration tasks.
• Proficiency in building and optimizing Power BI reports and dashboards.
• Familiarity with Spark Streaming for real-time data processing.

Key Skills

Education

Any Graduate