AI QA Tester

AI QA Tester

We are currently recruiting for an AI QA Tester with automation testing experience to join one of our Insurance clients on a 6-month contract.

Inside IR35, Remote Working

Experience required:

• Strong QA engineering background with hands-on test automation, not manual scripting alone.
• Automation coding ability in Python, C# and/or JavaScript/TypeScript.
• API testing experience, including contract testing, authentication, negative testing and mocked dependencies.
• Demonstrable experience testing AI, machine learning or LLM-based systems, or a clear grasp of how to assure non-deterministic output using evaluation metrics and statistical thresholds.
• Understanding of RAG architectures and where they fail - retrieval misses, stale indexes, chunk boundary loss, hallucination, ungrounded citations.
• Awareness of LLM security risks (for example the OWASP Top 10 for LLM applications) and practical adversarial testing technique.
• CI/CD integration of automated test suites (GitHub Actions or Azure DevOps).
• Test data management, including handling of personal data safely in test environments.
• Confidence challenging engineers and stakeholders on release readiness.
• Experience with Azure AI Foundry evaluations, Azure AI Content Safety testing or PyRIT / other red-teaming tooling.
• Performance and load testing tools (k6, JMeter, Azure Load Testing).
• Azure Monitor / Application Insights and KQL for investigating failures from telemetry.
• Accessibility and conversational UX testing experience.
• Familiarity with UK GDPR, DPIA processes or regulated-sector assurance evidence.

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.