QA Engineer – GenAI & Agentic AI
Aftab AlamRemoteMIDPosted 2h ago
GenAILLM TestingAgentic AIRAG TestingLangChainLangGraphCrewAIAutoGenQA AutomationAPI TestingPythonPyTestPostmanREST APIsRAGASDeepEvalTruLensAI guardrailsprompt injectionjailbreak testingAI securityvector databasesPineconeFAISSChromaDBAzure AI SearchSeleniumPlaywrightCypressResponsible AIAI governance
About the Role
EazyML is looking for a skilled QA Engineer – GenAI & Agentic AI to join their team and help ensure the reliability, accuracy, performance, and security of next-generation AI applications.
Key Responsibilities
• Test and validate GenAI and Agentic AI applications
• Evaluate LLM responses for accuracy, relevance, and consistency
• Validate RAG pipelines and multi-agent workflows
• Identify hallucinations, edge cases, and AI security vulnerabilities
• Develop automated test cases and improve overall product quality
Requirements
• 3–7 years of experience in QA engineering
• Experience testing LLM-based applications, prompt engineering, hallucination detection, and AI response validation
• Understanding of AI agents, multi-agent workflows, RAG pipelines, agent orchestration, and frameworks such as LangChain, LangGraph, CrewAI, or AutoGen
• Strong experience in Python, PyTest, API testing (Postman/REST APIs), functional testing, and automation frameworks