Jobs → QA & Testing → AI QA Tester

About the Role We are looking for an AI QA Tester to validate AI agents and conversational applications, evaluate response quality, identify defects, and collaborate with development teams to improve AI reliability. Key Responsibilities • Testing AI agents, chatbots, and LLM-based applications • Creating test scenarios, evaluation datasets, and regression test suites • Evaluating response accuracy, relevance, hallucinations, and task completion • Testing multi-turn conversations, edge cases, and error handling • API testing, defect tracking, and test documentation Requirements • Hands-on project experience with Bluejay AI or Maxim AI • Testing AI agents, chatbots, and LLM-based applications • Creating test scenarios, evaluation datasets, and regression test suites • Evaluating response accuracy, relevance, hallucinations, and task completion • Testing multi-turn conversations, edge cases, and error handling • API testing, defect tracking, and test documentation Preferred Skills • Python and test automation • Voice AI testing • Prompt evaluation and RAG testing • AI agent monitoring and trace analysis • CI/CD integration for automated evaluations