Staff Quality Engineer
StackAdapt3 months ago
Toronto, CanadaStaff+
Responsibilities
- Own the end-to-end quality strategy for the Automation and Intelligence Pillar’s AI products from test architecture through release readiness.
- Design and build evaluation frameworks for non-deterministic systems, including LLM output quality, agent behavior, regression detection, and guardrail and safety testing.
- Develop scalable automated test suites and tooling for functional, system, API, integration, UI, and regression testing, and integrate them into CI/CD pipelines.
- Establish quality metrics and benchmarks for accuracy, latency, cost, hallucination rates, and failure rates.
- Partner with Engineering Managers, Product Managers, Designers, ML and Data Science teams, and other engineering groups on requirements and definitions of done.
- Mentor the QE organization, promote best practices, drive process improvements, and improve AI testing across the company.
- Participate in technical planning, code reviews, and architectural decisions while advocating for testability and reliability.
- Provide timely and actionable test-result feedback to the product pod, QA team, and stakeholders.
Requirements
- 7+ years of professional hands-on software quality and test automation experience, including setting technical direction on complex systems.
- Hands-on experience with API and UI test automation frameworks such as Playwright, Cypress, Jest, or JUnit.
- Fluency in TypeScript, JavaScript, Python, or Java, with a preference for TypeScript.
- Experience testing AI or agentic systems, including evaluations, prompt and regression testing, and output validation.
- Experience using AI to scale automation, including test generation, self-healing tests, and failure triage, with technologies such as OpenAI and Anthropic.
- Experience with CI/CD tools such as Jenkins, GitHub Actions, or CircleCI.
- Strong understanding of scalable system design for web-based APIs and backend processing systems.
- In-depth understanding of QA methodologies in software companies with fast release cycles.
- Experience defining test case design standards and coverage strategies for edge, negative, compatibility, performance, and concurrency scenarios.
- Experience owning a test case management practice such as TestRail.
- Knowledge of React, including adding data-testids.
- Ability to explore codebases and use technical tools to understand implementation.
- Experience coaching and influencing cross-functional teams on tooling, testing plans, strategies, and execution.
Benefits
- Remote-first work arrangement, open to candidates anywhere in Canada and the United States.
- Retirement, 401(k), and pension savings programs globally.
- Competitive paid time off, including birthday leave.
- Mental health care program and health benefits from the first day of employment.
- Work-from-home reimbursements.
- Optional global WeWork membership and access to London and Toronto hubs.
- Training, onboarding, and personal development support, including conferences, courses, and books.
- Parental leave program and social and team events.
Tech Stack
Categories
About StackAdapt
StackAdapt builds a programmatic demand-side platform that lets brands and agencies plan, buy, and optimize digital ads across native, display, video, connected TV, and audio. Its AI-driven platform supports cross-channel targeting, measurement, and attribution, sold as SaaS/media through managed and self-serve campaigns. Founded in 2014 and headquartered in Toronto, the company is privately held and serves customers across North America, EMEA, APAC, and LATAM.