Jobs → QA & Testing → Senior QA Engineer

Senior QA Engineer

Srikanth SamudralaUnited StatesSENIORPosted 44m ago
PythonAPI AutomationAI Evaluation FrameworksLangChainLangGraphAWS BedrockRAGASDeepEvalLangSmithSQLAgile
About the Role We are seeking a hands-on Senior QA Engineer with strong experience testing Agentic AI, LLM, and RAG-based applications. Key Responsibilities • Test AI agent reasoning, decision-making, tool calling, and multi-agent orchestration • Validate LLM accuracy, hallucinations, response consistency, and contextual relevance • Perform end-to-end testing of RAG pipelines, retrieval mechanisms, and AI workflows • Develop Python-based test automation and API testing frameworks • Build automated AI evaluation and regression testing solutions • Validate prompts, edge cases, failure scenarios, and AI guardrails • Hands-on exposure to LangChain, LangGraph, and AWS Bedrock • Experience with RAGAS, DeepEval, and LangSmith Requirements • 8+ years QA / Test Automation • Hands-on Agentic AI / LLM / RAG testing • Python & API Automation • AI Evaluation Frameworks • LangChain / LangGraph • Strong SQL, debugging, and Agile experience

Similar projects

Performance Test Engineer
SHARVARI INGALE · Performance Testing, JMeter, LoadRunner
Test Automation Specialist
Libin Bhardwaj · Playwright, TypeScript, Python
Test Engineer
Pujitha M · QA Leadership, Test Management, Jira Administration
Early · 0 applied1 of 4,928 projects

Apply with AI cover letter

AI writes a personalized application in 19 seconds. Just upload your resume.

No credit card · First application free
© 2026 Freelanly · Terms · Privacy