Description

You will build and manage large-scale data processing systems using Python and Spark.

Responsibilities

• Perform real-time, large-scale data processing in distributed environments.
• Use the Python API for Apache Spark to build data pipelines.
• Utilize the PySpark shell for interactive data analysis.
• Develop and maintain data processing workflows using Python.

Required Skills

• 5+ years of professional experience in data development.
• Expertise in Python.
• Hands-on experience with PySpark.
• Proficiency with PySpark Shell for interactive analysis.
• Experience managing distributed data environments.
• Adobe Photoshop.
• Degree in any technical field.

Key Skills

Education

Any Graduate