Description

You will build and optimize scalable data pipelines and ETL automation within an Azure environment.

This role is on-site.

Responsibilities

• Design and build scalable data pipelines using Databricks and Python to process large datasets.
• Develop and optimize data lakes and backend architectures for efficient ETL processes.
• Integrate middleware solutions like MuleSoft to facilitate data processing between SAP and Databricks.
• Manage healthcare-related data including claims, pharma, and PHI/PII while adhering to privacy regulations.
• Implement security measures such as tokenization for sensitive data.

Required Skills

• 5+ years of experience in Databricks and ETL development.
• Strong background in Azure Data Engineering.
• Proficiency in Azure Data Factory.
• Advanced knowledge of Python for data engineering tasks.
• Experience handling PHI/PII or HIPAA-protected data.
• Familiarity with healthcare or pharma-related data and compliance standards.
• Expertise in ETL automation and development.

Preferred Skills

• Experience integrating middleware solutions such as MuleSoft.
• Knowledge of SAP data processing workflows.

Key Skills

Education

Any Gradute