Description

You will administer Databricks infrastructure, supporting the analyst community with troubleshooting and query resolution.

Responsibilities

• Manage and troubleshoot Databricks clusters and Unity Catalog at scale.
• Resolve issues in notebooks and monitor system tables.
• Handle deployments and infrastructure administration for AWS environments.
• Collaborate with analysts to address Databricks-related queries.

Required Skills

• 5+ years of hands-on experience in Databricks administration.
• Strong expertise in AWS services: S3, Lambda, and EMR.
• Proficiency in Spark and Python coding.
• Experience with Docker and Kubernetes.
• Ability to troubleshoot and monitor complex data workflows.
• Understanding of data warehousing and data handling fundamentals.

Preferred Skills

• Databricks Certified Engineer certification.

Key Skills

Education

Any Graduate