Description

You will build and maintain data processing pipelines and web applications using Python and big data frameworks.

This role is on-site.

Responsibilities

• Develop big data processing workflows using Apache Spark and PySpark.
• Build and manage application logic using Django and Airflow.
• Deploy and manage containerized services using Docker and Kubernetes.
• Implement and maintain code within public cloud environments.

Required Skills

• 4+ years of software engineering experience.
• 3+ years of experience with Apache Spark for big data processing.
• Proficiency in Python and PySpark.
• 1+ years of development experience with Django.
• 1+ years of development experience with Airflow.
• 1+ years of experience with cloud development, specifically Google Cloud Platform.
• Hands-on experience with Docker and Kubernetes concepts including pods, deployments, services, and images.
• Experience writing shell scripts.

Key Skills

Education

Any Gradute