Description

You will design and manage production-grade Databricks environments and data architectures for cloud platforms.

Responsibilities

• Deploy and configure Databricks clusters, SQL warehouses, and workspace settings.
• Manage cluster access, SQL warehouse permissions, and workspace asset security.
• Implement data governance, security protocols, and secure access to external storage.
• Monitor Databricks performance and develop custom plugins for monitoring statistics.
• Automate cloud operations and manage environment setup via virtual machines.

Required Skills

• 5+ years of experience in Databricks architecture and clustered deployment.
• Deep knowledge of Delta Lake structure and Databricks networking.
• Proficiency in Python, SQL, Shell scripting, Perl, and Hive.
• Experience with CI/CD pipelines and cloud automation.
• Hands-on experience with Azure, AWS, or GCP.
• Strong UNIX skills including user management, security, and permissions.
• Understanding of hardware fundamentals including CPU, memory, disk, and networking.
• Ability to manage Databricks integration and connectivity with external systems.

Preferred Skills

• Experience with firewall configuration and network security within cloud environments.

Key Skills

Education

Any Graduate