Jobs → Data & Analytics → Quality Analyst – AI / Chatbot Evaluation

About the Role We are looking for detail-oriented Quality Analysts to evaluate and compare AI chatbot responses for accuracy, relevance, completeness, clarity, and overall quality. This is an exciting opportunity to contribute to AI evaluation and help improve the quality and reliability of advanced AI systems. Key Responsibilities • Evaluate and compare responses generated by multiple AI chatbots • Review outputs for accuracy, relevance, completeness, and consistency • Identify factual errors, inconsistencies, missing information, and quality issues • Provide structured feedback and final assessments • Follow detailed evaluation guidelines and maintain high-quality standards • Document findings and escalate complex or ambiguous cases • Meet productivity, accuracy, and turnaround-time targets Requirements • Experience in Quality Assurance, Data Annotation, Content Evaluation, Testing, or Data Quality • Strong analytical, critical-thinking, and problem-solving skills • Excellent written communication and attention to detail • Ability to follow detailed guidelines and work independently • Familiarity with AI tools, chatbots, or online evaluation platforms • Prior experience in LLM evaluation, chatbot testing, or AI data-quality projects is a plus Work Schedule • 8 hours per day, 5 working days per week • Weekend availability as required, with 2 weekdays off • 4 hours of daily overlap with the PST time zone Contract Duration: 16 Weeks