Jobs → QA & Testing → AI Tester

AI Tester

Shaik SamirUnited StatesMIDPosted 4h ago
AIGenAIConversational AIRAGAgentic AILLMJira
About the Role We are looking for an experienced AI Tester to support testing and quality assurance of AI/GenAI solutions, including Conversational AI, RAG, and Agentic AI systems. The ideal candidate will validate AI solutions against functional, business, and technical requirements while ensuring accuracy, reliability, consistency, and quality. Key Responsibilities • Develop and execute test plans, test cases, and evaluation scenarios for AI/GenAI solutions. • Test AI-generated outputs for accuracy, relevance, consistency, and completeness. • Perform negative, edge-case, and adversarial testing. • Validate content retention, AI guardrails, and response quality. • Identify unexpected AI behavior and document defects. • Track testing metrics and provide clear testing readiness recommendations. Requirements • Experience in Software QA and Testing. • AI/ML or Generative AI testing experience preferred. • Familiarity with LLMs and AI evaluation techniques. • Experience with Jira or other test management and defect tracking tools. • Strong analytical and problem-solving skills. • Experience in regulated industries or public-sector environments is a plus.

Similar projects

Performance Tester
Prateek Mishra · Java, Jmeter, Performance Test Engineering
Core Manual QA Tester
Sivabalan Durai · Manual QA Testing, Financial Services, Banking
Manual QA Engineer
Nadya B. · client-server architecture, distributed systems, API testing
Early · 0 applied1 of 5,311 projects

Apply with AI cover letter

AI writes a personalized application in 19 seconds. Just upload your resume.

No credit card · First application free
© 2026 Freelanly · Terms · Privacy