Description

You will manage Databricks infrastructure and administration to support analyst workflows and resolve technical queries.

Responsibilities

• Manage Databricks clusters at scale and troubleshoot issues within notebooks.
• Administer Databricks Unity Catalog and utilize Databricks System tables.
• Monitor and troubleshoot data platform performance and stability.
• Deploy and maintain infrastructure using Docker and Kubernetes.
• Support the analyst community by addressing technical queries and debugging Spark/Python code.

Required Skills

• 5+ years of experience in data infrastructure and administration.
• Hands-on expertise with Databricks, including Unity Catalog and cluster management.
• Strong knowledge of AWS services, specifically S3, Lambda, and EMR.
• Proficiency in Spark and Python coding.
• Experience with Azure environments.
• Practical experience using Docker and Kubernetes.
• Solid fundamentals in Data Warehousing (DW) and Data Hydration (DH).
• Databricks Certified Engineer credential.
• Any Graduate degree.

Key Skills

Education

Any Graduate