Description

You will design and maintain data pipelines using Azure Databricks, Python, and SQL within a healthcare context.

Responsibilities

• Develop and optimize ETL processes using Azure Databricks and Python.
• Manage data storage and queries in Cosmos DB and SQL.
• Implement real-time data streaming solutions with Kafka.
• Collaborate in Agile environments to deliver scalable data infrastructure.
• Ensure data integrity and performance across cloud services.

Required Skills

• 11+ years of experience in data engineering.
• Proficiency in Azure Databricks and Python.
• Strong SQL skills for data manipulation and analysis.
• Experience with Cosmos DB for NoSQL data management.
• Hands-on experience with Kafka for streaming data.
• Ability to work effectively in an Agile framework.
• Good communication skills for cross-functional collaboration.

Key Skills

Education

Any Graduate