Description

Job description

Responsibilities

1The ideal candidate will have a good understanding of big data technologies data engineering and cloud computing DWH Projects with a focus on Azure Databricks

2Work closely with business stakeholders and other IT teams to understand requirements and define the scope for engagement with reasonable timeline

3Ensure proper documentation of architecture processes while ensuring compliance with security and governance standards

4Ensure best practices are followed by team in terms of code quality data security and scalability

5Stay updated with the latest developments in Databricks and associated technologies to drive innovation

6Positive attitude and excellent communication skills to manage customer calls Excellent problemsolving skills Good communication Team collaboration

Essential Skills

Overall 12 years of experience along with 5 years of data Analytics project experience

Experience with Azure Databricks notebook development and Delta Lake

Good understanding of Azure services like Azure Data Lake Azure Synapse and Azure Data Factory Fabric

Experience with ETLELT processes data warehousing and building data lakes

SQL skills and familiarity with NoSQL databases

Experience with CICD pipelines and version control systems like Git

Soft Skills

Excellent communication skills with the ability to explain complex technical concepts to nontechnical stakeholders

Strong problemsolving skills and a proactive approach to identifying and resolving issues

Leadership skills with the ability to manage and mentor a team of data engineers

Nice to have Skills

Power BI for dashboarding and reporting

Microsoft Fabric for analytics and integration tasks

Spark Streaming for processing realtime data streams

Experience

1Over 12 years of IT experience including 4 years specializing in developing data ingestion and transformation pipelines using DatabricksSynapse notebooks and Azure Data Factory

2Good understanding on different domainindustries with respect to data Analytics project DWH projects

3Should be good in Excel and Power Point

4Good understanding and experience with Delta tables Delta Lake and Azure Data Lake Storage Gen2

5Experience in building and optimizing query layers using Databricks SQL

6Familiarity with modern CICD practices especially in the context of Databricks and cloudnative solutions

Key Skills

Education

Any Graduate