Description

You will manage and optimize Databricks environments to support machine learning and data science workflows.

Responsibilities

• Advise on architecture and scaling strategies for Databricks environments.
• Configure data storage, notebooks, and compute resources to meet business requirements.
• Install, configure, and maintain Databricks clusters, workspaces, and tenant management.
• Monitor cluster performance, resource utilization, and cost management.
• Troubleshoot technical issues and document solutions in an internal knowledge base.

Required Skills

• 3 years of experience in data architecture or administration.
• Proficiency in Python and PySpark.
• Strong knowledge of SQL.
• Experience building and optimizing complex data pipelines in Azure.
• Hands-on experience with Databricks cluster and workspace management.
• Experience managing cloud resources and account usage monitoring.
• Ability to provide occasional on-call technical support.

Preferred Skills

• Experience supporting machine learning and data science workflows.

Key Skills

Education

Not specified