Description

Build and maintain data pipelines using AWS and Scala.

Responsibilities

• Develop data processing applications using Scala and PySpark.
• Manage data workflows within the AWS ecosystem.
• Write and maintain automated tests using Pytest and Behave.
• Ensure code quality through rigorous testing frameworks.

Required Skills

• 10+ years of professional experience in data engineering.
• Proficiency with Scala.
• Hands-on experience with AWS services.
• Strong Python programming skills.
• Experience with PySpark for distributed data processing.
• Experience writing unit tests with Pytest.
• Experience with Behave for behavior-driven development.

Key Skills

Education

Any Graduate