Jobs → QA & Testing → Agentic QA Engineer

About the Role We are looking for an experienced Agentic QA Engineer to join a long-term onsite project in Dallas, TX. This role focuses on testing generative AI and multi-agent systems. Key Responsibilities • Test agentic AI and multi-agent system functionality • Perform generative AI and LLM testing • Develop Python automation scripts • Implement testing with LangChain, LangGraph, LlamaIndex, and DSPy • Utilize OpenAI Assistants and Azure OpenAI services • Set up CI/CD pipelines using GitHub Actions and Azure DevOps • Conduct resiliency, chaos engineering, and performance testing • Monitor systems with OpenTelemetry, Grafana, and Datadog • Test AWS and distributed systems • Apply MLOps and LLM evaluation frameworks Requirements • 11+ years of IT experience • 7+ years in QA/Testing • 2+ years of hands-on experience with AI/ML, LLMs, or Agentic AI systems • Experience testing agent orchestration, tool calling, multi-agent workflows, and AI guardrails