Description

Lead testing strategy and automation standards for Generative AI models and NLP systems within the Center of Excellence.

This role is on-site.

Responsibilities

• Define validation standards and testing strategies for Generative AI and NLP systems.
• Develop automation frameworks for AI and machine learning workflows.
• Integrate testing processes into DevOps and Agile workflows.
• Provide technical guidance and best practices to the Generative AI community.
• Distill complex technical analysis into concise takeaways for business and technology leadership.

Required Skills

• 10+ years of experience in software testing and test automation.
• Expert-level Python programming with data and AI/ML libraries.
• Proven experience testing NLP, AI systems, and Generative AI models.
• Advanced experience with API testing and SQL.
• Experience with big data transformation.
• Experience working in an Agile environment within the financial services industry.
• Strong communication skills for presenting technical concepts to stakeholders.
• Experience working with DevOps processes.

Key Skills

Education

Any Graduate