Jobs → QA & Testing → Quality Engineer – Test Automation & AI Assurance

About the Role Rayosys is seeking an experienced Quality Engineer specializing in Test Automation and AI Assurance to join their remote team. This role involves ensuring software quality through advanced testing methodologies and AI evaluation. Key Responsibilities • Implement and maintain automated testing frameworks using Playwright, Cypress, and Pytest • Conduct API and contract testing to ensure system integrity • Evaluate Large Language Models (LLMs) and AI agents for performance and reliability • Perform RAG (Retrieval-Augmented Generation) testing and detect hallucinations in AI outputs • Conduct prompt injection and adversarial testing to identify security vulnerabilities • Integrate testing into CI/CD pipelines Requirements • 5+ years of experience in quality engineering or test automation • Strong knowledge of Playwright, Cypress, and Pytest • Experience with API and contract testing • Understanding of CI/CD principles and tools • Familiarity with LLM evaluation and AI agent testing • Knowledge of RAG, hallucination detection, and adversarial testing techniques