Staff Quality Engineer
StackAdaptResponsibilities
- Own the end-to-end quality strategy for the Automation and Intelligence Pillar’s AI products from test architecture through release readiness.
- Design and build evaluation frameworks for non-deterministic systems, including LLM output quality, agent behavior, regression detection, and guardrail and safety testing.
- Develop scalable automated test suites and tooling for functional, system, API, integration, UI, and regression testing, and integrate them into CI/CD pipelines.
- Establish quality metrics and benchmarks for accuracy, latency, cost, hallucination rates, and failure rates.
- Partner with Engineering Managers, Product Managers, Designers, ML and Data Science teams, and other engineering groups on requirements and definitions of done.
- Mentor the QE organization, promote best practices, drive process improvements, and improve AI testing across the company.
- Participate in technical planning, code reviews, and architectural decisions while advocating for testability and reliability.
- Provide timely and actionable test-result feedback to the product pod, QA team, and stakeholders.
Requirements
- 7+ years of professional hands-on software quality and test automation experience, including setting technical direction on complex systems.
- Hands-on experience with API and UI test automation frameworks such as Playwright, Cypress, Jest, or JUnit.
- Fluency in TypeScript, JavaScript, Python, or Java, with a preference for TypeScript.
- Experience testing AI or agentic systems, including evaluations, prompt and regression testing, and output validation.
- Experience using AI to scale automation, including test generation, self-healing tests, and failure triage, with technologies such as OpenAI and Anthropic.
- Experience with CI/CD tools such as Jenkins, GitHub Actions, or CircleCI.
- Strong understanding of scalable system design for web-based APIs and backend processing systems.
- In-depth understanding of QA methodologies in software companies with fast release cycles.
- Experience defining test case design standards and coverage strategies for edge, negative, compatibility, performance, and concurrency scenarios.
- Experience owning a test case management practice such as TestRail.
- Knowledge of React, including adding data-testids.
- Ability to explore codebases and use technical tools to understand implementation.
- Experience coaching and influencing cross-functional teams on tooling, testing plans, strategies, and execution.
Benefits
- Remote-first work arrangement, open to candidates anywhere in Canada and the United States.
- Retirement, 401(k), and pension savings programs globally.
- Competitive paid time off, including birthday leave.
- Mental health care program and health benefits from the first day of employment.
- Work-from-home reimbursements.
- Optional global WeWork membership and access to London and Toronto hubs.
- Training, onboarding, and personal development support, including conferences, courses, and books.
- Parental leave program and social and team events.
Tech Stack
Categories
About StackAdapt
StackAdapt is the leading technology company that empowers marketers to reach, engage, and convert audiences with precision. With 465 billion automated optimizations per second, the AI-powered StackAdapt Marketing Platform seamlessly connects brand and performance marketing to drive measurable results across the entire customer journey. The most forward-thinking marketers choose StackAdapt to orchestrate high-impact campaigns across programmatic advertising and marketing channels. Our state-of-the-art platform is where some of the most progressive work in machine learning meets cutting-edge user experience. StackAdapt is designed around the three core pillars of programmatic—planning, executing and analyzing. StackAdapt is ranked as the number 1 DSP on G2. For six consecutive years with over hundreds of reviews, StackAdapt has been recognized as a high performer and the highest-ranking DSP in customer satisfaction by G2. StackAdapt was also recognized as an Enterprise Fast 15 winner as part of the Technology Fast 50™ program in 2024 and is one of Ad Age’s Best Places to Work in 2024. Learn more about StackAdapt here: www.stackadapt.com. And if you're looking for a change, we'd love to have you on our team—check out our open roles by visiting: www.stackadapt.com/careers. StackAdapt is headquartered in Toronto, Canada. We have teams and client support across North America, EMEA, APAC, and LATAM.