Description

Key Skills: Python, ServiceNow, Databricks, Terraform, Azure, ADLS, REST APIs, Bash, PowerShell, CI/CD

Good to Have Skills: Azure DevOps, Azure Functions, Logic Apps, Key Vault, Event Grid, Automation Accounts, Delta Lake, Unity Catalog permissions, job orchestration, DLT, cluster policies, cost/performance optimization, Dremio REST APIs, reflection management, source automation, backup/restore testing, Kubernetes/AKS deployment knowledge, AKS/GKE experience, Helm, kubectl, YAML-based deployments.

Roles & Responsibilities:

• Automate common ServiceNow request workflows related to data platform access, onboarding, approvals, fulfilment, and operational requests.
• Build or enhance self-service applications that integrate with ServiceNow and raise requests on behalf of users.
• Develop automated backup scripts and scheduled jobs for platform components such as Databricks Unity Catalog/metastore, Dremio metadata, configuration, ADLS objects, and other platform assets.
• Build tested restore scripts and runbooks for Dremio metadata, Databricks views, catalog objects, platform configurations, and other recoverable assets.
• Support ADLS disaster recovery planning, backup validation, failover readiness, and recovery testing.
• Create reusable scripts, notebooks, templates, and automation patterns for Databricks workloads, views, jobs, and pipelines.
• Work with platform users to review and optimize Databricks pipelines, improve performance, reduce cost, and promote reusable engineering patterns.
• Develop and maintain Terraform modules for Azure/GCP infrastructure used by the data platform.
• Build and maintain CI/CD pipelines using GitHub Actions/GitHub runners for deploying infrastructure, scripts, configurations, and platform automation.
• Help reduce repetitive operational work by identifying automation opportunities and implementing robust, reusable solutions.
• Own automation tasks end-to-end, from requirements gathering through development, testing, deployment, and support handover.
• Lead team with 70% time in design, architecture, and coding and 30% time in team mentoring, guidance, and coordination.

Experience Required: Strong scripting experience using Python, Bash, PowerShell, or similar languages with ability to build production-ready automation scripts. Experience integrating with ServiceNow APIs, automating ticket creation, request fulfilment, approvals, and workflow-driven processes. Good working knowledge of Databricks workspaces, jobs, notebooks, clusters, SQL warehouses, Unity Catalog/metastore concepts, views, and pipeline optimization. Strong expertise to debug and fix post production issues for developed code

Key Skills

Education

Any Graduate