Description

You will build and optimize scalable data pipelines on Databricks, transforming a legacy file-based environment into a modern, cloud-native data platform.

This role is on-site.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks, Python, and SQL.
• Implement Medallion Architecture (Bronze, Silver, Gold) for reliable data processing.
• Build reusable frameworks and automation instead of one-off scripts.
• Apply data governance best practices using Unity Catalog for security and lineage.
• Modernize legacy batch processing into cloud-native solutions.

Required Skills

• 5+ years of experience with Databricks.
• Strong Python programming skills.
• Experience developing scalable ETL/ELT pipelines.
• Strong SQL and data modeling experience.
• Understanding of modern cloud data platforms and data architecture.
• Knowledge of software engineering best practices.

Preferred Skills

• Experience with Unity Catalog and data governance.
• Background in healthcare or regulated industries.
• Interest in AI and automation practices.

Key Skills

Education

Any Graduate