Description

You will build and manage data pipelines within an Azure-based healthcare data environment.

Responsibilities

• Design and optimize ETL processes using Python and Databricks.
• Execute data transformations, error handling, and logging to load data into Delta tables.
• Manage data flow across systems using Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.
• Lead data engineering projects to ensure system scalability.
• Collaborate with cross-functional teams to implement data solutions.

Required Skills

• 5+ years of experience in data engineering and building data pipelines.
• Expertise in Python, PySpark, and Databricks.
• Proficiency with Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake.
• Strong knowledge of data modeling and Azure services.
• Experience with Unix shell scripting and scheduling tools.
• Any Graduate degree.

Preferred Skills

• Healthcare domain experience.

Key Skills

Education

Any Graduate