Description

Experience in generating data pipelines in Azure ADB

· Experience in ingesting data from different Sources using in Azure ADB

· Experience in transforming the data using Azure Databricks & Delta lake and Pyspark

· Experience in Azure DevOps CI/CD – Stories, Bugs, and Issue management

· Implement Integration solution in Microsoft Azure

· Performs data analysis required to troubleshoot data related issues and assist in the resolution

of data issues

· Experience working in agile development projects and sprint deliver

· Collaborate with cross-functional teams to elicit data requirements and architect effective

data pipelines.

· Perform data transformations and cleansing operations to ensure data accuracy and

consistency.

· Evolve existing scripts and notebooks to meet client needs.

· Monitor, troubleshoot, and optimize data pipelines for seamless functionality.

· Ensure data solutions align with security and compliance standards

· Work closely with data architects to harmonize data models with project objectives

Key Skills

Education

Bachelor's degree