Description

You will own the administration, engineering, and operationalization of the Databricks platform for Data Engineering, Data Science, and MLOps use cases.

Responsibilities

• Engineer and operationalize Databricks in production environments to support large-scale data workloads.
• Manage platform governance and security using Unity Catalog.
• Automate infrastructure deployment using Terraform and Infrastructure as Code principles.
• Integrate Databricks with CI/CD tools including GitHub and Jenkins.
• Optimize data platform processes, pipelines, architectures, and transformations.

Required Skills

• 5+ years of experience in platform engineering or data engineering.
• Extensive experience with Databricks and Unity Catalog.
• Proficiency with Azure cloud platform.
• Strong experience with Terraform for infrastructure as code.
• Advanced Python programming skills.
• Experience configuring Databricks integrations with GitHub, Jenkins, and Tableau.
• Hands-on experience with Databricks streaming technologies and Delta Live Tables.
• Experience integrating Databricks with Snowflake and MongoDB.
• Degree in any graduate field.

Preferred Skills

• Expert level SQL knowledge across various engines including Snowflake, MySQL, CosmosDB, or SQL Server.

Key Skills

Education

Any Graduate