Senior Automation Test Engineer/SDET (Playwright + AI) at Nix

N-iX is looking for Senior Automation Test Engineer/SDET (Playwright + AI) to join the team About the client: Our client is a cutting-edge, technology focused company that provides a better way of detecting and managing risks that may impact the outcome of clinical trials. Their solutions, all of which are cloud-based, are driven by a unique set of algorithms that interrogate clinical and operational data in real-time centrally to conveniently illuminate outliers and anomalies in data. The Role: We are looking for a highly skilled AI Tester with strong Playwright expertise who embraces an AI-First approach to quality engineering. In this role, your primary focus will be testing AI-powered features implemented within the application — ensuring their reliability, accuracy, robustness, explainability, and compliance with product expectations. While automation remains a critical capability, this role requires a strong understanding of how AI-driven functionality behaves in real-world scenarios, including edge cases, model variability, and prompt-driven outputs. You will play a key role in validating AI features end-to-end — from requirement analysis and test design to automated validation, exploratory testing, and model behavior analysis — while continuing to leverage AI tools like GitHub Copilot/Codex to accelerate test development. Responsibilities: • Designing and executing comprehensive test strategies specifically for AI-powered features within the application • Validating AI outputs for accuracy, consistency, edge-case handling, and alignment with business requirements • Designing prompt-based and scenario-driven tests to evaluate model behavior under varied inputs • Defining measurable validation criteria for non-deterministic systems( confidence ranges, tolerance thresholds, expected behavior patterns) • Collaborating with engineering and product teams to improve explainability, observability, and traceability of AI decisions • Ensuring AI features meet quality, compliance, and audit requirements where applicable • Leveraging AI coding assistants (e.g., GitHub Copilot, Codex, or similar tools) to accelerate test development and framework enhancement • Using AI tools to generate high-quality test scenarios from requirements and user stories • Reviewing, validating, and refining AI-generated test code to ensure accuracy, scalability, and maintainability • Contributing to AI-driven test design patterns and reusable automation strategies • Promoting AI-augmented productivity practices within the QA team • Designing, developing, and maintaining scalable Playwright-based automation frameworks for UI, API, and end-to-end testing • Integrating automated test suites into CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins, etc.) • Performing exploratory testing to uncover edge cases, usability gaps, and unexpected system behavior Required Qualifications: • 5+ years of commercial experience in tests automation • Experience testing AI-driven or data-driven systems (LLMs, ML models,rule engines, recommendation systems, NLP-based features, etc.) • Understanding of AI/ML behavior concepts such as prompt variability, non-deterministic outputs, confidence thresholds, bias, hallucinations, and edge-case handling. • Ability to design validation strategies for probabilistic systems where results may not always be binary (pass/fail) • Strong hands-on experience with Playwright automation framework • Proficiency in JavaScript or TypeScript • Demonstrated expertise using GitHub Copilot, Codex, or AI coding assistants as part of daily development workflow • Solid understanding of automation framework architecture and design patterns • Experience integrating automated tests into CI/CD pipelines • Experience with test management tools such as Zephyr, Xray, or similar • Strong understanding of software testing fundamentals (test design techniques, defect lifecycle, risk analysis) • Proven experience in manual and exploratory testing of web applications • Excellent analytical, debugging, and communication skills • Upper-Intermediate/Advanced English level Nice to have • Experience validating AI systems in regulated environments (auditability, traceability, explainability requirements) We offer*: • Flexible working format - remote, office-based or flexible • A competitive salary and good compensation package • Personalized career growth • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more) • Active tech communities with regular knowledge sharing • Education reimbursement • Memorable anniversary presents • Corporate events and team buildings • Other location-specific benefits *not applicable for freelancers