Description

You will administer and architect Databricks platforms, ensuring stability, security, and cost efficiency for data engineering workflows.

This role is on-site.

Responsibilities

• Administer Databricks environments, including Unity Catalog, Delta Lake, and Delta Live Tables.
• Manage Databricks Workflows, SQL Warehouses, and compute resources.
• Implement cost optimization strategies and manage DBU usage across cloud accounts.
• Automate infrastructure and deployment pipelines using Git, CI/CD, and shell scripting.
• Maintain system reliability through Unix/Linux administration and incident management via Jira/ServiceNow.

Required Skills

• 7+ years of experience in data engineering or platform engineering.
• 4+ years of hands-on Databricks administration and architecture.
• Strong proficiency in Python and PySpark for data processing.
• Expertise in Databricks Unity Catalog, Delta Lake, and Delta Live Tables.
• Experience with cloud platforms (AWS, Azure, or GCP).
• Proficiency in Bash/Shell scripting and Unix/Linux administration.
• Knowledge of CI/CD tools and ITSM platforms like Jira or ServiceNow.
• Bachelor's degree in a relevant technical field.

Key Skills

Education

Bachelor's degree