Description

You will design and implement data pipelines within the Azure ecosystem to support complex data workflows.

This role is remote.

Responsibilities

• Build data pipelines using Azure Databricks leveraging Python and Spark.
• Translate client requirements into technical data solutions.
• Design databases and manage ETL processes within Azure Data Lake Gen2.
• Provide technical assistance, troubleshooting, and problem resolution.
• Operate within SDLC and Agile methodologies to deliver production-ready code.

Required Skills

• 8+ years of experience in data engineering.
• Expertise in Azure Databricks (ADB), Python, and Spark.
• Strong hands-on experience with Azure Data Factory (ADF).
• Proficiency in Azure Data Lake Gen2 and database design.
• Solid understanding of ETL patterns and SQL.
• Experience with SDLC and Agile frameworks.
• Proven experience working on at least 2-3 live projects.
• Knowledge of the healthcare domain.
• Experience with Tidal Scheduler.

Preferred Skills

• Experience with Synapse Analytics (dedicated SQL pool) and Delta Lake.
• Knowledge of Scala programming.
• Background in Production Support projects.

Key Skills

Education

Any Gradute