Description

You will build data pipelines and automated testing frameworks in an AWS serverless environment.

Responsibilities

• Develop data processing logic using Python and Spark.
• Build and maintain serverless workflows using AWS Glue.
• Implement automated testing including behave frameworks, live dependency testing, and component testing using 7ps.
• Manage deployment cycles through Jenkins CI/CD pipelines.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency in Python and Spark development.
• Hands-on experience with AWS Glue and serverless architectures.
• Experience with automated testing frameworks such as behave.
• Knowledge of component testing and live dependency testing.
• Experience using 7ps for testing.
• Practical experience with Jenkins and CI/CD workflows.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Experience building APIs.
• Prior front-end development skills.

Key Skills

Education

Any Graduate