Description

You will design and maintain geospatial data pipelines using PySpark and Databricks on Azure.

This role is hybrid.

Responsibilities

• Lead the implementation of geospatial data solutions using PySpark and Databricks.
• Integrate data from multiple sources into Azure Event Hub for real-time processing.
• Manage and secure data assets using Azure Key Vault.
• Develop and maintain Databricks Workflows to automate data processing tasks.
• Administer Databricks Workspace and use Databricks SQL for complex geospatial queries.

Required Skills

• 5+ years of experience in data engineering roles.
• Strong expertise in PySpark for data processing and analysis.
• Extensive experience with Azure Event Hub for real-time integration.
• Proficiency in managing data security with Azure Key Vault.
• Advanced knowledge of Databricks Workflows for automation.
• Experience in Databricks Workspace administration.
• Proficiency with Databricks CLI for data operations.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate