Description

You will design, manage, and maintain cloud computing infrastructure and data systems.

Responsibilities

• Build performant data pipelines and optimize existing workflows to support new features.
• Implement, maintain, and operate data pipelines using Apache Spark, Scala, and cloud infrastructure.
• Manage the full data lifecycle, including lineage, governance, privacy, retention, and anonymity.
• Automate processes and handle scripting tasks using Python.
• Collaborate with cross-functional teams including Product Owners, Scrum Masters, Developers, and Test Engineers using agile methodologies.

Required Skills

• 4+ years of experience working with large scale data sets.
• Proficiency in Python for scripting and automation.
• Hands-on experience with Apache Spark and Scala.
• Experience working within AWS cloud environments.
• Strong understanding of data lifecycle concepts such as governance, lineage, and privacy.
• Bachelor's degree in Computer Science.
• Experience working in agile environments.

Key Skills

Education

Bachelor's degree in Computer Science