Description

You will own the development and maintenance of big data processing logic and cloud infrastructure.

This role is on-site.

Responsibilities

• Develop and maintain data processing logic using Spark and Scala.
• Build and manage scalable data workloads within AWS environments.
• Implement data transformations using Python and PySpark.
• Manage data storage and querying via Hive and S3.
• Build and optimize big data pipelines.

Required Skills

• 5+ years of professional experience in data development.
• Proficiency in PySpark and Python.
• Experience with Spark and Scala.
• Hands-on expertise with Hive.
• Direct experience with AWS, specifically EMR and S3.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Background in data warehouse environments.

Key Skills

Education

Any Graduate