Description

Design and implement high-performance data ingestion pipelines using Apache Spark and Azure Databricks.

This role is on-site.

Responsibilities

• Design and implement scalable data ingestion pipelines from multiple sources.
• Build performant data processing workflows using Apache Spark.
• Develop reusable frameworks specifically for geospatial datasets.
• Deliver and present proofs of concept for key technology components to stakeholders.

Required Skills

• 5+ years of professional experience.
• Strong proficiency with Azure Databricks.
• Hands-on experience with Apache Spark.
• Strong Python programming skills.
• Experience with Azure cloud environments.
• Degree in any field.

Preferred Skills

• Experience with geospatial data processing.

Key Skills

Education

Any Gradute