Description

You will design, build, and optimize scalable data pipelines and ETL automation within an Azure environment.

Responsibilities

• Design and maintain scalable data pipelines in Azure using Python and Databricks.
• Build and optimize data lakes and backend architectures for large-scale data processing.
• Implement ETL automation and data transformation tasks to ensure efficient data movement.
• Collaborate with data architects, DBAs, and product owners to align on technical requirements.
• Integrate middleware solutions like MuleSoft for data processing between SAP and Databricks.

Required Skills

• 5+ years of experience in Databricks and ETL development.
• Proficiency in Python for data engineering tasks.
• Hands-on experience with Azure cloud technologies.
• Experience designing and optimizing ETL processes for large datasets.
• Expertise handling sensitive healthcare data, including pharma, claims, and PHI/PII.
• Knowledge of implementing security measures such as tokenization for data privacy.
• Ability to work with complex backend architectures and data lakes.
• Degree in any graduate field.

Preferred Skills

• Familiarity with healthcare or pharma-specific data structures.

Key Skills

Education

Any Gradute