Description

Own the design, development, and migration of scalable data pipelines and analytics solutions in a healthcare environment.

This role is on-site.

Responsibilities

• Build and maintain scalable data pipelines using Databricks (Delta Lake, Spark) and Azure Data Factory.
• Write optimized SQL and Python for data transformation, automation, and complex logic.
• Migrate legacy ETL jobs from DataStage to Azure, ensuring data integrity and performance.
• Create actionable visualizations and reports using Tableau or Power BI for stakeholders.
• Manage CI/CD pipelines, GitHub version control, and workflow orchestration with Databricks Workflows or Airflow.

Required Skills

• 5+ years of hands-on experience with Databricks, Delta Lake, and Spark.
• Advanced proficiency in SQL and Python for data engineering tasks.
• Experience with Azure Data Factory (ADF) and modern BI tools (Tableau/Power BI).
• Strong understanding of healthcare data models, claims, and clinical datasets.
• Practical experience with CI/CD, GitHub, and deployment best practices.
• Familiarity with Agile frameworks and Jira for sprint planning.
• Experience leveraging AI-assisted development tools for productivity.

Preferred Skills

• Exposure to PostgreSQL and domain-specific compliance considerations.
• Proven track record of leading technical delivery in onsite environments.

Key Skills

Education

Any Gradute