Description

You will administer Databricks infrastructure on AWS, supporting analysts with troubleshooting and query resolution.

Responsibilities

• Administer Databricks environments, including cluster management and deployment at scale.
• Troubleshoot notebook issues and resolve Databricks-related queries for the analyst community.
• Monitor system performance and utilize Databricks System Tables for diagnostics.
• Implement and manage Unity Catalog for governance.

Required Skills

• 5+ years of hands-on experience with Databricks infrastructure and administration.
• Strong proficiency in AWS services, specifically S3, Lambda, and EMR.
• Must have strong Spark and Python coding capabilities.
• Experience with Docker and Kubernetes.
• Deep understanding of Data Warehouse and Data Lake fundamentals.
• Databricks Certified Engineer certification required.
• Strong skills in monitoring and troubleshooting complex infrastructure issues.

Preferred Skills

• Experience managing clusters at scale in a production environment.

Key Skills

Education

Any Graduate