Description

Design, develop, and optimize large-scale data processing workflows using Apache Spark and deploy cloud-native platforms on GCP and OpenShift.

This role is hybrid.

Responsibilities

• Build and optimize large-scale data processing workflows using Apache Spark and PySpark.
• Deploy, configure, and maintain cloud-native data processing platforms on GCP and OpenShift.
• Implement security measures including RBAC and data encryption to ensure compliance.
• Monitor system health and troubleshoot distributed systems for high performance.
• Collaborate with cross-functional teams to define requirements and support production deployments.

Required Skills

• 3+ years of experience working with Apache Spark for big data processing.
• 2+ years of Django development experience.
• 2+ years managing containerized environments with OpenShift or Kubernetes.
• 1+ years of creating and maintaining conda environments.
• Proficiency in Python.
• Proficiency in Scala or Java.

Key Skills

Education

Any Graduate