Description

You will manage and scale complex BigData, Data Science, and ML hosting platforms built on Databricks, Snowflake, and Elasticsearch.

Responsibilities

• Build, scale, and monitor Databricks, Snowflake, and Elasticsearch cloud environments.
• Design architecture and define roadmaps for the Data platform and Data science workbench.
• Implement monitoring, alerting, and observability using CSP tools, Zabbix, and Datadog.
• Manage Databricks workspaces, Unity Catalog, audit logs, and user access control.
• Troubleshoot platform-level issues and optimize usage for performance and cost.

Required Skills

• 5+ years of experience in operations or systems administration, specifically on Linux.
• Hands-on Databricks administration, including workspace management, SSO, and provisioning.
• Experience managing Databricks clusters, jobs, policies, templates, and pools.
• Expertise in Docker and cloud-based containerization technologies.
• Strong coding skills in SQL and Python (PySpark) with code optimization experience.
• Proficiency with YAML, Helm charts, az cli, aws-cli, and Powershell.
• Experience managing storage account access and implementing disaster recovery for BigData platforms.
• Ability to assist in Network, Data security, and IAM initiatives.

Preferred Skills

• Experience optimizing Databricks usage for performance and cost.
• Experience strategizing and implementing Disaster Recovery for BigData platforms.

Key Skills

Education

Any Gradute