Description

You will build and maintain distributed data processing systems using Python and Spark.

Responsibilities

• Perform real-time, large-scale data processing within distributed environments.
• Implement data processing logic using the Python API for Apache Spark.
• Use the PySpark shell to interactively analyze datasets.
• Maintain and optimize distributed data processing systems.

Required Skills

• 5-8 years of experience in data engineering or big data development.
• Strong Python programming skills.
• Proficiency with PySpark.
• Hands-on experience with large-scale data processing.
• Experience with the Python API for Apache Spark.
• Technical degree in a relevant field.

Key Skills

Education

Any Tech Graduate