Description

You will design and implement data pipelines and ensure data quality across AWS environments.

Responsibilities

• Process and analyze data using AWS Glue and Snowflake.
• Develop and maintain data quality testing procedures.
• Automate testing processes using Selenium and Pytest.
• Write complex queries and transformations using SQL and PySpark.

Required Skills

• 5+ years of experience in Data Engineering.
• Expert proficiency in Python and PySpark.
• Strong command of SQL.
• Experience with AWS services, specifically AWS Lambda and AWS Glue.
• Familiarity with Snowflake for data warehousing.
• Experience with test automation frameworks.
• Knowledge of test management tools, including qTest and Pytest.
• Proficiency in Selenium for test automation.

Key Skills

Education

Bachelor's degree