Description

You will design, develop, and optimize large-scale data processing workflows using Apache Spark. You will deploy, configure, and maintain cloud-native data processing platforms on GCP and OpenShift.

Responsibilities

• Build and optimize large-scale data processing workflows using Apache Spark and PySpark.
• Deploy and maintain cloud-native data platforms on GCP and OpenShift.
• Implement security measures including RBAC and data encryption to ensure compliance.
• Monitor system health and troubleshoot distributed systems for high performance.
• Collaborate with cross-functional teams to define requirements and support production deployments.

Required Skills

• 3+ years of experience working with Apache Spark for big data processing.
• 2+ years of Django development experience.
• 2+ years managing containerized environments with OpenShift or Kubernetes.
• 1+ years of creating and maintaining conda environments.
• Proficiency in Python, Scala, or Java.

Key Skills

Education

Any Graduate