Description

Architect and lead data engineering initiatives on Azure, focusing on Databricks, Delta Lake, and cloud-native solutions. You will define technical scope, ensure code quality, and mentor data engineering teams.

Responsibilities

• Define architecture scope and timelines for data analytics and DWH projects.
• Build and optimize data ingestion pipelines using Databricks, Synapse, and Azure Data Factory.
• Enforce security, governance, and code quality standards across the team.
• Mentor data engineers and communicate technical concepts to non-technical stakeholders.
• Maintain comprehensive documentation for architecture processes and compliance.

Required Skills

• 12+ years IT experience, including 4+ years with Databricks/Synapse notebooks.
• Expertise in Azure Databricks, Delta Lake, and Azure Data Lake Storage Gen2.
• Strong experience with Azure Synapse and Azure Data Factory (including Fabric).
• Proficiency in SQL and NoSQL databases.
• Hands-on experience with CI/CD pipelines and Git version control.
• Experience building and optimizing query layers using Databricks SQL.
• Strong problem-solving skills and ability to manage customer calls.

Preferred Skills

• Power BI for dashboarding and reporting.
• Spark Streaming for real-time data stream processing.
• Experience with Microsoft Fabric for analytics and integration tasks.

Key Skills

Education

Any Graduate