3 months ago
United Kingdom (city not specified)Senior
Responsibilities
- Own the quality strategy for the AI agent platform, including testing approaches for non-deterministic and LLM-powered systems.
- Build and maintain automated unit, integration, API, and end-to-end test suites across the TypeScript, Node.js, React, and Python stack.
- Develop evaluation frameworks for agent reasoning, tool use, memory, and multi-step interaction flows.
- Test and validate web, messaging, voice, and other omnichannel communication experiences.
- Collaborate with engineering and product teams to define acceptance criteria and identify quality risks early.
- Champion testability, test coverage, and quality standards across the development process.
- Use and help shape AI-assisted testing tools to improve coverage and identify issues.
Requirements
- Proven experience as a Senior QA Engineer working on complex, production software products.
- Strong hands-on experience with test frameworks such as Playwright, Cypress, or Jest.
- Experience testing APIs, backend services, and databases such as PostgreSQL.
- Understanding of testing non-deterministic systems and experience designing and implementing QA strategy.
- Strong communication skills for explaining quality risks to technical and non-technical stakeholders.
- Experience evaluating LLM or agentic systems, prompt behavior, output quality, hallucination risks, or agent evaluation frameworks is preferred.
- Experience with performance, load, or chaos testing for real-time or event-driven systems is preferred.
- Background in automotive, dealership technology, or B2B SaaS is preferred.
- Exposure to AI-assisted development and testing tools such as GitHub Copilot, Cursor, or Claude Code is preferred.
Benefits
- Training, development support, and opportunities to explore different career paths.
- Inclusive and diverse work environment with equal opportunity commitments.
- Pay and benefits designed to reflect performance, with investment in employee development and collaboration.
- No academic qualifications are required; selection is based on experience and potential.
Tech Stack
Categories
About Keyloop
Keyloop builds software for automotive retail, including dealer management, CRM, service, and digital retailing platforms used by dealerships and car manufacturers. It sells SaaS and services that connect retailers with OEMs across the sales and aftersales lifecycle. The company is privately held and headquartered in Reading, England, and reports adoption by over 20,000 retailers and 80 OEMs in more than 90 countries.