QA Engineer / SDET II – AI Testing
Arjun RajaUnited StatesSENIORPosted 6d ago
PythonPytestOOPPandasDataFramesSeleniumPlaywrightGenerative AILLMsAgentic AIPrompt validationHallucination detectionAI output evaluationGuardrail testingREST APIMicroservicesIntegration testingSQLNoSQLCI/CDDevOpsAWSJMeterRAGAI agentsMCPLangChainAI observability tools
About the Role
We are looking for an experienced SDET II / QA Automation Engineer with strong coding skills in Python and Selenium, along with hands-on experience testing Generative AI, Agentic AI, and AI-powered applications.
Key Responsibilities
• Design and implement automated tests for AI applications
• Develop and maintain test automation frameworks using Python and Selenium
• Perform UI automation testing with Selenium (Playwright is a plus)
• Test Generative AI, LLMs, and Agentic AI applications
• Conduct prompt validation, hallucination detection, AI output evaluation, and guardrail testing
• Perform REST API, microservices, and integration testing
• Validate SQL/NoSQL databases and backend systems
• Implement CI/CD pipelines and DevOps practices
• Conduct performance testing using JMeter or similar tools
• Utilize RAG, AI agents, MCP, LangChain, and AI observability tools
Requirements
• 8+ years in QA / SDET / Test Automation
• 6+ years in UI automation and API testing
• Strong hands-on coding experience in Python, Pytest, OOP, Pandas, and DataFrames
• Expertise in UI automation using Selenium
• Experience testing Generative AI, LLMs, and Agentic AI applications
• Knowledge of prompt validation, hallucination detection, AI output evaluation, and guardrail testing
• Strong REST API, microservices, and integration testing experience
• Experience with SQL/NoSQL databases and backend validation
• Familiarity with CI/CD, DevOps, and cloud platforms such as AWS
• Performance testing experience using JMeter or similar tools
• Knowledge of RAG, AI agents, MCP, LangChain, and AI observability tools
Important Requirements
• Only candidates currently local to New Jersey will be considered
• Valid ID proof is required
• Candidates must be available for a final face-to-face interview