Description

You will design, develop, and optimize large-scale data processing workflows using Apache Spark on GCP and OpenShift. You are responsible for deploying and maintaining cloud-native platforms, implementing RBAC and data encryption for compliance, and monitoring distributed systems to ensure high performance. You will collaborate with cross-functional teams to define requirements and support production deployments.

Responsibilities

• Design and optimize large-scale data processing workflows using Apache Spark.
• Deploy, configure, and maintain cloud-native data processing platforms on GCP and OpenShift.
• Implement security measures including RBAC and data encryption to ensure compliance.
• Monitor system health and troubleshoot distributed systems to ensure high performance and reliability.
• Collaborate with cross-functional teams to define requirements and support production deployments.

Required Skills

• 3+ years of experience working with Apache Spark for big data processing.
• 2+ years of Django development experience.
• 1+ years of creating and maintaining conda environments.
• 2+ years managing containerized environments with OpenShift or Kubernetes.
• Proficiency in Python, Scala, or Java.
• Experience with GCP cloud infrastructure.

Key Skills

Education

Any Graduate