Description

You will manage the configuration, deployment, and maintenance of Databricks clusters and workspaces. You will ensure infrastructure consistency and optimize platform performance and cost.

Responsibilities

• Provision and deploy Databricks clusters, workspaces, and AWS resources using Terraform.
• Monitor cluster performance, resource utilization, and auto-scaling to optimize for performance and cost.
• Implement and enforce security policies, RBAC, access controls, and encryption mechanisms.
• Manage platform feature releases, software updates, and backup/disaster recovery strategies.
• Collaborate with data teams to integrate Databricks with data lakes and warehouses while providing technical support.

Required Skills

• 5+ years of professional experience in data platform administration.
• Deep expertise with the Databricks Platform.
• Proficiency in Terraform for infrastructure as code provisioning.
• Experience managing AWS resources and Azure Cloud environments.
• Proven ability to implement RBAC and security access controls.
• Strong capability to manage and optimize platform costs and resource utilization.

Preferred Skills

• Experience providing user training and technical support to data engineers and scientists.

Key Skills

Education

Any Graduate