Description

Design and maintain scalable data pipelines and ETL/ELT processes using Azure cloud technologies. You will build Azure Data Factory workflows, manage Azure Data Lake Gen2, and optimize SQL for relational and NoSQL databases.

This role is hybrid.

Responsibilities

• Develop and optimize ETL/ELT processes for enterprise data integration using Azure Data Factory and Data Lake Gen2.
• Build data services with Python (FastAPI) and manage Azure Databricks and Azure Functions.
• Implement CI/CD pipelines using Git and Jenkins to ensure robust deployment practices.
• Integrate APIs and manage API Gateway solutions for secure data access.
• Collaborate with cross-functional teams to deliver high-quality, secure data solutions.

Required Skills

• 10+ years of experience as a Data Engineer.
• Strong hands-on expertise with Microsoft Azure Cloud services, including Azure Data Factory, Data Lake Gen2, Databricks, Functions, and Databases.
• Proficiency in Azure Data Fabric and API Gateway Management.
• Strong SQL skills with experience in both RDBMS and NoSQL databases.
• Experience developing data services using Python frameworks, specifically FastAPI.
• Proven background in ETL/ELT development and optimization.
• Experience with CI/CD tools including Git and Jenkins.

Preferred Skills

• Bachelor's degree in Computer Science or related field.
• Experience maintaining roles for 5+ years.

Key Skills

Education

Bachelor's degree