Test Automation Engineer
Victor RodgersUnited StatesSENIORPosted 1h ago
PlaywrightSeleniumPythonTypeScriptJavaC#PostmanRestAssuredJenkinsGitHub ActionsGitLab CIAzure DevOpsAgileBDDTDD
About the Role
We are seeking an experienced Principal Test Automation Engineer to lead quality engineering for enterprise solutions involving Agentic AI workflows and Large Language Model integrations.
Key Responsibilities
• Architect scalable automation frameworks using Playwright and Selenium
• Develop automated testing across UI, API, and generative AI interfaces
• Validate LLM accuracy, guardrails, prompts, and non-deterministic outputs
• Build API automation suites for microservices and backend systems
• Integrate automated quality gates into CI/CD pipelines
• Collaborate with machine-learning engineers, developers, and product teams
Requirements
• 16+ years in software quality engineering and test automation
• Hands-on Agentic AI and LLM testing experience
• Advanced Playwright and Selenium WebDriver expertise
• Strong Python, TypeScript, Java, or C# skills
• API automation using tools such as Postman or RestAssured
• CI/CD experience with Jenkins, GitHub Actions, GitLab CI, or Azure DevOps
• Familiarity with Agile, BDD, TDD, and shift-left testing
Experience with AI evaluation frameworks, vector databases, semantic-search testing, Docker, and relevant ISTQB or DevOps certifications is desirable.