Description

You will build and maintain data processing pipelines using cloud and big data technologies.

Responsibilities

• Process and analyze data using AWS Lambda, AWS Glue, and Snowflake.
• Develop and implement data quality testing procedures focused on AWS environments.
• Automate testing processes using Selenium and Pytest.
• Apply strong problem-solving skills to resolve data integrity issues.

Required Skills

• 5+ years of experience in Data Engineering.
• Proficiency in Python, PySpark, and SQL.
• Experience with Snowflake for data warehousing.
• Hands-on experience with AWS Lambda and AWS Glue.
• Familiarity with test automation frameworks and Selenium.
• Experience using test management tools like qTest and pytest.
• Knowledge of data quality testing principles.

Key Skills

Education

Any Gradute