Description

JOB DESCRIPTION:

We are seeking a Data Engineer to join a team building a modern, cloud-native data platform using Databricks. This is a greenfield opportunity to help transform a legacy, file-based environment into a scalable, automated, and well-governed data ecosystem. Rather than maintaining existing systems, you'll help build reusable frameworks, modern architecture, and platform capabilities that support analytics, AI, and future business initiatives.

Responsibilities

• Design, develop, and optimize scalable data pipelines using Databricks, Python, and SQL.
• Build reusable ETL/ELT frameworks and automation rather than one-off data pipelines.
• Design solutions following the Medallion Architecture (Bronze, Silver, Gold) to support reliable and scalable data processing.
• Implement data governance best practices using Unity Catalog, including security, lineage, and access controls.
• Modernize legacy file-based and batch processing into cloud-native solutions.
• Collaborate with technical teams on platform architecture, engineering standards, and best practices.

Required Qualifications

• Hands-on experience with Databricks.
• Strong Python programming skills.
• Experience developing scalable ETL/ELT pipelines.
• Strong SQL and data modeling experience.
• Experience working with modern cloud data platforms.
• Understanding of data architecture and software engineering best practices.
• Strong communication skills with the ability to explain technical decisions and collaborate effectively.

Preferred Qualifications

• Experience with Unity Catalog and data governance.
• Experience implementing Medallion Architecture.
• Experience building reusable frameworks, accelerators, or shared engineering components.
• Background in healthcare or other regulated industries.
• Interest in AI, automation, and modern data engineering practices

Key Skills

Education

Any Graduate