Description

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure cloud technologies.

Build and optimize ETL/ELT processes for enterprise data integration.

Develop and manage Azure Data Factory (ADF) workflows and Azure Data Lake Gen2 solutions.

Work with Azure Databricks, Azure Functions, and Azure databases to support data engineering initiatives.

Integrate APIs and manage API Gateway solutions.

Develop data services using Python frameworks such as FastAPI.

Optimize SQL queries and work with both relational and NoSQL databases.

Implement CI/CD pipelines using Git, Jenkins, and DevOps best practices.

Collaborate with cross-functional teams to deliver secure, high-quality data solutions.

Required Qualifications

10+ years of experience as a Data Engineer.

Strong hands-on experience with Microsoft Azure Cloud services.

Expertise in:

Azure Data Factory (ADF)

Azure Data Lake Gen2

Azure Databricks

Azure Functions

Azure Databases

Azure Data Fabric

API Gateway Management

Strong SQL skills with experience in RDBMS and NoSQL databases.

Experience with Python frameworks such as FastAPI.

Strong background in ETL/ELT development.

Experience with CI/CD tools including Git and Jenkins

Key Skills

Education

Bachelor's degree