Description

You will lead the design and implementation of data analytics solutions on Azure, focusing on Databricks and Delta Lake.

Responsibilities

• Define the scope and timeline for data engineering engagements by collaborating with business stakeholders and IT teams.
• Design and build scalable data ingestion and transformation pipelines using Azure Databricks, Synapse, and Data Factory.
• Ensure architecture processes comply with security and governance standards while maintaining comprehensive documentation.
• Mentor the data engineering team to enforce best practices in code quality, data security, and scalability.
• Optimize query layers using Databricks SQL and manage Delta Lake architectures.

Required Skills

• 12+ years of IT experience, including 5+ years in data analytics and data warehousing projects.
• 4+ years specializing in data ingestion and transformation pipelines using Databricks, Synapse notebooks, and Azure Data Factory.
• Strong proficiency with Azure Data Lake Storage Gen2, Azure Synapse, and Azure Data Factory.
• Hands-on experience with Delta Lake, Delta tables, and SQL.
• Experience with ETL/ELT processes and building data lakes.
• Familiarity with NoSQL databases and version control systems like Git.
• Understanding of CI/CD pipelines and modern cloud-native practices.
• Ability to explain complex technical concepts to non-technical stakeholders.

Preferred Skills

• Experience with Microsoft Fabric for analytics and integration tasks.
• Proficiency in Power BI for dashboarding and reporting.
• Experience with Spark Streaming for real-time data processing.

Key Skills

Education

Any Graduate