AI Quality Assurance Engineer
Suresh kumar Raju ChintaUnited StatesSENIORPosted 4d ago
AI/MLGenerative AILLM testingprompt engineeringhallucination detectionPythonPytestAPI testingPostmanFunctional testingIntegration testingRegression testingEnd-to-end testingRAG pipelinesVector databasesEmbeddingsSemantic searchAI security testingPrompt injectionBias validationToxicity validationJiraCI/CDTest documentation
About the Role
We are looking for an experienced AI Tester / AI QA Engineer with strong expertise in software testing, test automation, Generative AI, and Large Language Model (LLM) testing.
Key Responsibilities
• Test AI/ML and Generative AI applications
• Perform LLM testing, including prompt engineering and hallucination detection
• Develop Python and Pytest automation scripts
• Conduct API testing using Postman or Python frameworks
• Execute functional, integration, regression, and end-to-end testing
• Work with RAG pipelines, vector databases, embeddings, and semantic search
• Perform AI security testing, including prompt injection, bias, and toxicity validation
• Utilize Jira, CI/CD, and maintain test documentation
Requirements
• Strong expertise in software testing and test automation
• Experience with Generative AI and Large Language Model (LLM) testing
• Proficiency in Python and Pytest
• Knowledge of API testing using Postman or Python frameworks
• Experience with functional, integration, regression, and end-to-end testing
• Understanding of RAG pipelines, vector databases, embeddings, and semantic search
• Familiarity with AI security testing, prompt injection, bias, and toxicity validation
• Experience with Jira, CI/CD, and test documentation