AI Tester
Shaik SamirUnited StatesMIDPosted 4h ago
AIGenAIConversational AIRAGAgentic AILLMJira
About the Role
We are looking for an experienced AI Tester to support testing and quality assurance of AI/GenAI solutions, including Conversational AI, RAG, and Agentic AI systems. The ideal candidate will validate AI solutions against functional, business, and technical requirements while ensuring accuracy, reliability, consistency, and quality.
Key Responsibilities
• Develop and execute test plans, test cases, and evaluation scenarios for AI/GenAI solutions.
• Test AI-generated outputs for accuracy, relevance, consistency, and completeness.
• Perform negative, edge-case, and adversarial testing.
• Validate content retention, AI guardrails, and response quality.
• Identify unexpected AI behavior and document defects.
• Track testing metrics and provide clear testing readiness recommendations.
Requirements
• Experience in Software QA and Testing.
• AI/ML or Generative AI testing experience preferred.
• Familiarity with LLMs and AI evaluation techniques.
• Experience with Jira or other test management and defect tracking tools.
• Strong analytical and problem-solving skills.
• Experience in regulated industries or public-sector environments is a plus.