Description

You own the development and maintenance of Azure Databricks solutions within a scrum team.

Responsibilities

• Design and implement data pipelines using Azure Databricks for cleaning, transforming, and loading data into a Data Lakehouse.
• Assist with Azure Databricks deployments, testing, configuration, and installation.
• Ensure database resiliency and disaster recovery capabilities through managing backups, restores, redundancy, and geo-replication.
• Troubleshoot configuration and performance issues across Azure data services.
• Create detailed documentation and facilitate knowledge sharing for team collaboration.

Required Skills

• 5+ years experience with Azure Databricks Analytics database capabilities and relational database technologies in Azure.
• 5+ years experience with Azure Data Lake Storage Gen 2, Azure Databricks, Azure Data Explorer, Azure Event Hubs, Spark Pools, Python, PySpark, SQL, Azure Landing Zone, Azure Networking Services, and Microsoft EntraID.
• 5+ years experience with Azure geo-redundancy and HA/failover technologies.
• 5+ years experience designing and implementing data pipelines using Azure Databricks.
• 5+ years experience with Infrastructure as Code (IaC) tools such as Terraform.
• 5+ years experience with programming languages like Python, PySpark, and data constructs such as JSON or XML.
• Strong experience with relational and/or dimensional data modeling.
• Understanding of implementing Medallion Architecture using Azure Services.
• Any Graduate education required.

Key Skills

Education

Any Graduate