Description

You build and manage large-scale data processing systems using Python and Spark.

This role is on-site.

Responsibilities

• Perform real-time, large-scale data processing in distributed environments.
• Build data pipelines using the Python API for Apache Spark.
• Develop and maintain data processing workflows in Python.
• Utilize the PySpark shell for interactive data analysis.

Required Skills

• 5+ years of professional experience in data development.
• Expertise in Python.
• Hands-on experience with PySpark.
• Proficiency with PySpark Shell for interactive analysis.
• Experience managing distributed data environments.
• Degree in a technical field.

Preferred Skills

• Adobe Photoshop.

Key Skills

Education

Any Graduate