Description

You will own the development and maintenance of big data processing logic and cloud infrastructure. Your work focuses on building scalable data workloads and managing storage within AWS environments.

Responsibilities

• Develop and maintain data processing logic using Spark and Scala.
• Build and manage data workloads within AWS environments.
• Implement data transformations using Python and PySpark.
• Manage data storage and querying via Hive and S3.
• Build and optimize big data pipelines.

Required Skills

• 5+ years of professional experience in data development.
• Proficiency in PySpark and Python.
• Experience with Spark and Scala.
• Hands-on expertise with Hive.
• Direct experience with AWS, specifically EMR and S3.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Background in data warehouse environments.

Key Skills

Education

Any Graduate