Jobs → QA & Testing → QA Engineer / SDET II – AI Testing

QA Engineer / SDET II – AI Testing

Arjun RajaUnited StatesSENIORPosted 6d ago
PythonPytestOOPPandasDataFramesSeleniumPlaywrightGenerative AILLMsAgentic AIPrompt validationHallucination detectionAI output evaluationGuardrail testingREST APIMicroservicesIntegration testingSQLNoSQLCI/CDDevOpsAWSJMeterRAGAI agentsMCPLangChainAI observability tools
About the Role We are looking for an experienced SDET II / QA Automation Engineer with strong coding skills in Python and Selenium, along with hands-on experience testing Generative AI, Agentic AI, and AI-powered applications. Key Responsibilities • Design and implement automated tests for AI applications • Develop and maintain test automation frameworks using Python and Selenium • Perform UI automation testing with Selenium (Playwright is a plus) • Test Generative AI, LLMs, and Agentic AI applications • Conduct prompt validation, hallucination detection, AI output evaluation, and guardrail testing • Perform REST API, microservices, and integration testing • Validate SQL/NoSQL databases and backend systems • Implement CI/CD pipelines and DevOps practices • Conduct performance testing using JMeter or similar tools • Utilize RAG, AI agents, MCP, LangChain, and AI observability tools Requirements • 8+ years in QA / SDET / Test Automation • 6+ years in UI automation and API testing • Strong hands-on coding experience in Python, Pytest, OOP, Pandas, and DataFrames • Expertise in UI automation using Selenium • Experience testing Generative AI, LLMs, and Agentic AI applications • Knowledge of prompt validation, hallucination detection, AI output evaluation, and guardrail testing • Strong REST API, microservices, and integration testing experience • Experience with SQL/NoSQL databases and backend validation • Familiarity with CI/CD, DevOps, and cloud platforms such as AWS • Performance testing experience using JMeter or similar tools • Knowledge of RAG, AI agents, MCP, LangChain, and AI observability tools Important Requirements • Only candidates currently local to New Jersey will be considered • Valid ID proof is required • Candidates must be available for a final face-to-face interview

Similar projects

QA Engineer
Shania Salsabila · QA, Software Testing, SDET
AEM QA Engineer
Archanaa Srivastav · AEM, Adobe Experience Manager, AEM 6.x
Salesforce CPQ QA Engineer
Archanaa Srivastav · Salesforce Testing, Salesforce CPQ, Manual Testing
Early · 0 applied1 of 7,964 projects

Apply with AI cover letter

AI writes a personalized application in 19 seconds. Just upload your resume.

No credit card · First application free
© 2026 Freelanly · Terms · Privacy