Description

Job Description :

- Understanding of Large Language Models (LLM), LangChain, and LangGraph frameworks

- Python programming skills with demonstrated ability to architect scalable test automation solutions.

- Deep hands-on experience with Generative AI and Agentic AI implementations in production environments

- Machine Learning model testing and validation methodologies

- Natural Language Understanding (NLU) testing strategies

- Natural Language Processing (NLP) quality assurance

- Knowledge of prompt engineering and LLM evaluation frameworks (RAGAS, DeepEval, etc.)

- Familiarity with vector databases for RAG testing

- Experience with performance and load testing of Gen AI applications

- Understanding of AI ethics, bias detection and responsible AI testing practices

- Comprehensive knowledge of AWS services, particularly Bedrock, Lambda and CloudWatch

- Experience architecting and implementing enterprise-scale cloud-based testing solutions

- Expert proficiency with version control systems (Git, Stash) and branching strategies

- Proven experience designing and optimizing CI/CD pipelines using Jenkins, GitLab CI, or similar tools

- Deep understanding of Agile/Scrum methodology, SDLC best practices, and DevOps culture

- Demonstrated ability to drive quality initiatives and establish testing excellence across organizations

- Proven expertise in leading cross-functional collaboration with development, product, and operations teams

- Experience establishing quality gates and governance frameworks for Gen AI applications

- Knowledge in UI, mobile and API testing methodologies

- Advanced proficiency with Behavior-Driven Development (BDD) frameworks and test design patterns

- Experience with test management and reporting tools including Jira, Xray, ALM, and TestRail

Some other highly valued skills include :
- Experience with containerization (Docker, Kubernetes) for test environments

- Background in data engineering or data quality testing

- Publications, conference presentations, or contributions to open-source testing frameworks

Key Skills

Education

Any Graduate