3 hours ago
San Francisco, CA, USAMid Level
Base Salary
$180k - $200k/yr
Responsibilities
- Test conversational workflows end to end, including command accuracy and actions performed on live clusters.
- Build evaluations for AI agent response quality, safe actions, and handling of ambiguous or invalid requests.
- Create end-to-end tests for web interfaces and verify consistent behavior across product interfaces.
- Write Go integration tests for backend workflows such as installation, upgrades, and failover.
- Provision and tear down Kubernetes test clusters to validate controllers, operators, and custom resources across versions.
- Verify alert delivery across product interfaces and chat.
- Gate releases in CI and turn bugs and incidents into regression tests.
Requirements
- At least 3 years of experience in QA, SDET, or test automation, including ownership of product quality and test suites.
- Strong Go skills for integration testing or backend test automation and experience building end-to-end web UI tests.
- Hands-on experience with Kubernetes, React, RPC systems such as gRPC, and Linux fundamentals.
- Familiarity with monitoring and alerting tools such as Prometheus, Alertmanager, or Grafana.
- Experience testing conversational or LLM-powered products, building agent evaluations, or working with GPU infrastructure is valuable.
- Exposure to multicluster tooling, chaos engineering, Kubernetes testing tools, and UI automation frameworks is a plus.
Benefits
- On-site role in San Francisco, California.