QA Lead
Nalini K.CanadaSENIORPosted 10d ago
AI testingDeepEvalPromptfooApplitoolsSaolaAIReflect AICopilot Studio KitUFTTOSCASeleniumCucumberJMeterLoadRunnerOpenText ALM/OctaneJIRAConfluenceServiceNowSalesforceSAP
About the Role
We are looking for a QA Lead with strong, hands-on AI testing experience to lead testing efforts on new and enhanced applications for a public sector client. This role involves owning QA from planning through execution and gating, and helping shape how AI-enabled systems are validated.
Key Responsibilities
• Lead test planning, estimation, coordination, and execution across projects
• Develop Master Test Plans, test cases, test scripts, and Test Completion Reports for gating
• Run functional, regression, integration, usability/accessibility, performance, and UAT testing
• Perform AI testing, including response accuracy, hallucination, prompt testing, prompt injection (security and privacy), and AI safety testing
• Build and maintain automated frameworks and conduct load and stress testing as needed
• Manage the full defect lifecycle and report progress to project teams and management
• Guide business users through User Acceptance Testing
Requirements
• 10+ years testing large-scale applications (on-premise web, cloud integrations, mobile)
• 3+ years of AI-assisted testing, including hands-on development of AI-powered QA agents using agentic AI, LLMs, and chatbot applications
• Hands-on experience with AI testing tools such as DeepEval, Promptfoo, Applitools, SaolaAI, Reflect AI, or Copilot Studio Kit
• Experience across all testing layers: UI, integration, regression, performance, AI-enabled systems, and UAT