Description

Lead data engineering initiatives on the Databricks platform, focusing on scalable ETL pipelines and Azure data architecture.

Responsibilities

• Design and build scalable ETL pipelines using Python and SQL.
• Manage Databricks workspaces, optimize clusters, and implement Delta Live Tables.
• Apply data modeling best practices within the Azure data platform.
• Lead engineering teams and resolve complex technical challenges.
• Integrate data using tools like Fivetran, dbt, or Coalesce where applicable.

Required Skills

• 10+ years of software engineering experience.
• 5-7 years of hands-on Databricks solution and data engineering.
• 5-7 years of Insurance data engineering experience.
• Expertise in Python and SQL for advanced data transformations.
• Experience with SQL Server, PostgreSQL, or Oracle.
• Strong understanding of Azure data platforms.
• Proven leadership experience managing successful teams.

Preferred Skills

• Databricks Engineer Associate or Professional Certification.
• Familiarity with Tableau or Power BI.

Key Skills

Education

Any Graduate