9 hours ago
San Francisco, CA, USAMid Level
Base Salary
$180k - $200k/yr
Responsibilities
- Test conversational workflows end to end, including response accuracy and actions on live clusters.
- Build evaluations for agent behavior, including correct answers, safe actions, and ambiguous or invalid requests.
- Create end-to-end tests for web interfaces and verify consistent behavior across interfaces.
- Write Go integration tests for backend workflows such as installation, upgrades, and failover.
- Provision and remove Kubernetes test clusters to validate controllers, operators, and custom resources across versions.
- Verify that alerts fire correctly and reach the appropriate chat and web interfaces.
- Gate releases in CI and convert bugs and incidents into regression tests.
Requirements
- At least 3 years of experience in QA, SDET, or test automation, including building or delivering test suites and automation frameworks.
- Strong Go skills, including backend test automation or integration testing, and experience building end-to-end tests for web UIs.
- Hands-on experience with Kubernetes, React, RPC systems such as gRPC, CI/CD, and Linux fundamentals.
- Familiarity with observability tools such as Prometheus, Alertmanager, or Grafana.
- Experience with LLM-powered or conversational products, agent evaluations, multicluster tools, or chaos and Kubernetes testing is valuable.
- Exposure to GPUs, bare-metal infrastructure, chat integrations, or UI testing frameworks such as Playwright is a plus.
Benefits
- On-site role in San Francisco, California.
- Visa sponsorship is not available.