Description

You will design and build scalable Python-based ETL frameworks with a strong emphasis on the transformation layer for Risk-Based Quality Management (RBQM).

Responsibilities

• Design and maintain Python packages to support robust ETL pipelines.
• Build and optimize data transformation pipelines using AWS Glue and PySpark.
• Process and transform data extensively using Polars and Pandas.
• Develop and maintain automated CI/CD pipelines using GitHub workflows.
• Implement testing strategies using Pytest/unittest and Moto for AWS service mocking.

Required Skills

• 8+ years of experience in Python development.
• 6+ years of experience with Polars, Pandas, and PySpark.
• 6+ years of experience with AWS Cloud, specifically AWS Glue.
• 5+ years of experience with unit testing frameworks (Pytest or unittest).
• 5+ years of experience with mocking frameworks like Moto.
• Strong experience with version control and CI/CD using GitHub workflows.
• Experience working with AI coding assistants or agents.

Key Skills

Education

Any Graduate