Quality Engineer / SDET
Pooja SehrawatCanadaMIDPosted 13d ago
QASDETTest AutomationAILLMGenAIChatbotsVirtual AssistantsConversational PlatformsPrompt EngineeringJiraConfluenceGitHubAgileAPI TestingAutomation FrameworksPythonSeleniumPlaywrightPyTest
About the Role
We are looking for a Quality Engineer / SDET to join our team, focusing on AI chatbot validation. This role involves ensuring chatbot responses are accurate, relevant, and consistent.
Key Responsibilities
• Validate chatbot responses for accuracy, relevance, completeness, and consistency.
• Create and execute test scenarios, test cases, and regression test suites.
• Identify hallucinations, incorrect responses, formatting issues, and knowledge gaps.
• Perform chatbot conversation analysis and recommend quality improvements.
• Develop and maintain test automation for chatbot validation where possible.
• Work closely with developers, AI engineers, and content teams to resolve defects.
• Track, document, and report defects, test results, and quality metrics.
• Support UAT, release validation, and production quality monitoring.
Requirements
• 5+ years of strong QA / SDET / Test Automation experience.
• Experience testing AI, LLM, GenAI, chatbots, virtual assistants, or conversational platforms.
• Knowledge of prompt engineering concepts
• Experience with Jira, Confluence, GitHub, and Agile delivery.
• Experience with API testing and automation frameworks.
• Strong analytical and troubleshooting skills.
• Experience with Python, Selenium, Playwright, PyTest, or similar tools.
• Strong communication and documentation skills.