Description

Build and manage backend data processing workflows using Python and Apache Spark on AWS.

This role is on-site.

Responsibilities

• Develop backend software using Python and Apache Spark.
• Build and manage data processing workflows using AWS services.
• Write and maintain unit tests to ensure code quality.
• Implement automation for data processing pipelines.
• Manage cloud infrastructure components including S3, EMR, and ECS.

Required Skills

• 5+ years of hands-on software engineering experience.
• Proficiency in Python.
• Experience with AWS services including S3, EMR, and ECS.
• Hands-on experience with Apache Spark.
• Strong understanding of backend data flows.
• Experience with unit testing and automation.
• Knowledge of cloud infrastructure.

Preferred Skills

• Terraform experience.

Key Skills

Education

Any Graduate