Description

You will design, build, and optimize data pipelines and asset models using Databricks and Spark.

This role is remote.

Responsibilities

• Design and manage data asset models and lifecycles.
• Tune Spark jobs and optimize distributed processing clusters.
• Implement observability across data workflows, including logging, metrics, and alerts.
• Manage the release pipeline using mature Git and CI/CD practices.

Required Skills

• 7+ years in Data Engineering.
• 3-5 years of experience with Databricks.
• Expertise in Spark, PySpark, and SQL.
• Strong experience with DBT (Core or Cloud).
• Deep skills in data asset modeling and optimization.
• Experience implementing observability patterns.
• Strong understanding of Delta Lake, governance, and lakehouse architectures.
• Proficiency with Git and CI/CD practices.
• Cloud experience, with Azure preferred.

Preferred Skills

• Azure cloud platform expertise.

Key Skills

Education

Any Gradute