You will design and implement high-performance data ingestion pipelines using Apache Spark and Azure Databricks. You own the development of scalable, reusable frameworks specifically for geospatial datasets.
Responsibilities
- Design and implement data ingestion pipelines from multiple sources.
- Build performant data processes using Apache Spark.
- Develop scalable, reusable frameworks for geospatial datasets.
- Deliver and present proofs of concept for key technology components to stakeholders.
Required Skills
- 5+ years of professional experience.
- Proficiency with Azure Databricks.
- Experience with Apache Spark.
- Strong Python skills.
- Experience with Azure cloud environments.
- Degree in any field.