Description

Develop data processing tasks and computationally intensive algorithms using Python and PySpark within a microservice architecture.

Responsibilities

• Develop data processing tasks using PySpark to read from external sources, merge data, and perform enrichment.
• Load processed data into target destinations.
• Design and implement algorithms for computationally intensive tasks.
• Apply end-to-end SDLC processes within a Python environment.
• Work within microservice architectures and big data/streaming concepts.

Required Skills

• 3+ years of professional experience.
• Expert-level Python coding skills.
• Expert knowledge of PySpark.
• Experience with Hadoop and Azure.
• Understanding of big data and streaming concepts.
• Knowledge of microservice architecture.
• Bachelor's degree.

Key Skills

Education

Bachelor's degree