Description

You will architect and implement Azure pipeline solutions to support data engineering and analytics initiatives.

This role is on-site.

Responsibilities

• Design and develop scalable Azure and .NET Core solutions aligned with business objectives.
• Architect data pipelines on Azure Databricks and develop ETL processes for ingestion and transformation.
• Implement real-time data integration for semi-structured data across RDBMS and NoSQL using Kafka and PySpark.
• Build and manage web and data solutions using Azure Function App, Web App, Storage, Cosmos DB, and Data Factory.
• Document architecture decisions and execute test plans and data quality rules.

Required Skills

• Minimum 5 years of experience in Azure, .NET Core, MS SQL, and Azure SQL.
• Over 7 years of total professional experience.
• Proficiency in Python, PySpark, SQL, SSIS, and C#.
• Experience with Azure Databricks, Azure Digital Twins (ADT), and healthcare domain requirements.
• Strong knowledge of software testing practices for data pipelines and foundational data architecture.
• Ability to design solutions using Kafka for real-time data integration.
• Optimize Azure Databricks workloads for performance, reliability, and cost-efficiency through partitioning and caching.

Preferred Skills

• Experience with data modeling, including building data warehouses from scratch using Star and Snowflake schemas.

Key Skills

Education

ANY GRADUATE