Description

Responsibilities Administer and support Databricks platforms across Azure and AWS environments. Implement Databricks security, Unity Catalog, RBAC, and data governance controls. Manage platform provisioning, maintenance, upgrades, and migrations.

Design and optimize Spark, Delta Lake, and enterprise data processing solutions. Support batch and real-time data ingestion using Kafka and Spark Streaming. Develop Infrastructure as Code (IaC) solutions using Terraform, Ansible, and Python. Manage cloud networking, private endpoints, DNS, firewalls, VNETs, and security controls. Monitor platform performance, availability, and operational health.

Drive FinOps initiatives, cloud cost optimization, and resource utilization governance. Support integration of Databricks with enterprise security and monitoring tools. Collaborate with architects, data engineers, and business stakeholders on solution design. Lead platform adoption, proof-of-concepts (PoCs), and modernization initiatives. Create technical documentation, standards, and operational procedures. Mentor junior engineers and provide technical leadership.

Ensure compliance, audit readiness, data classification, and masking requirements. Support DevOps, Kubernetes, CI/CD, and cloud-native deployment practices. Troubleshoot complex platform, security, networking, and performance issues

Key Skills

Education

Any Graduate