Quality Analyst
Anushka AroraUnited StatesMIDPosted 2h ago
Quality AssuranceData AnnotationContent EvaluationTestingAnalytical SkillsCritical ThinkingCommunicationAttention to DetailAI ToolsChatbotsOnline PlatformsLLM TestingChatbot Evaluation
About the Role
We are hiring Quality Analysts for a short-term, 16-week contract project focused on evaluating and improving AI chatbot responses.
Key Responsibilities
• Evaluate and compare responses generated by multiple AI chatbots
• Assess accuracy, relevance, completeness, and clarity
• Identify errors, inconsistencies, and quality issues
• Provide structured feedback and final assessments
• Follow evaluation guidelines and maintain quality standards
• Meet productivity, accuracy, and turnaround-time targets
Requirements
• 3+ years of experience in Quality Assurance, Data Annotation, Content Evaluation, Testing, or a similar role
• Strong analytical and critical-thinking skills
• Excellent written and verbal communication
• High attention to detail
• Familiarity with AI tools, chatbots, and online platforms
• Prior experience in LLM testing or chatbot evaluation is a plus
Benefits
• Fully remote and flexible work environment
• Opportunity to contribute to impactful AI applications
• Collaborate with global project teams