Description

Administer and maintain Databricks environments within AWS GovCloud, ensuring optimal performance, security, and uptime for data workflows.

Responsibilities

• Manage Databricks clusters, jobs, and workflows to ensure system reliability and performance in AWS GovCloud.
• Enforce security and compliance standards by configuring access controls, permissions, and identity management policies.
• Optimize data pipelines and resource allocation by analyzing performance metrics and implementing tuning strategies.
• Develop automation solutions for monitoring, reporting, and resource provisioning using AWS APIs and SDKs.
• Provide technical support, troubleshoot incidents, and conduct training sessions for data engineering and analytics teams.

Required Skills

• 5+ years of experience in cloud computing, specifically with AWS and a strong focus on AWS GovCloud.
• Proven expertise in administering and managing Databricks workspaces and integration with AWS services.
• Proficiency in AWS CloudFormation for infrastructure provisioning and management.
• Strong understanding of AWS services relevant to data engineering and analytics.
• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Ability to collaborate with DevOps, security, and data engineering teams to enforce best practices.
• Experience with documentation, reporting on system usage, and compliance adherence.

Preferred Skills

• AWS Solution Architect certification or equivalent architectural experience.
• Experience with data governance frameworks and integrity management.

Key Skills

Education

Bachelor's degree