1 day ago
San Francisco, CA, USAMid Level
Base Salary
$180k - $200k/yr
Responsibilities
- Test conversational workflows end to end, including command accuracy and actions performed on live clusters.
- Build evaluations for AI agent behavior, including response quality, safe actions, and ambiguous or invalid requests.
- Create end-to-end tests for the web interface and verify consistency across product interfaces.
- Write Go integration tests for backend workflows such as installation, upgrades, and failover.
- Provision and remove Kubernetes test clusters to validate controllers, operators, and custom resources across Kubernetes versions.
- Verify that alerts reach the appropriate interfaces and channels only when expected.
- Gate releases in CI and convert bugs and incidents into regression tests.
Requirements
- At least 3 years of experience in QA, SDET, or test automation, with experience building test suites or automation frameworks.
- Strong Go skills, including backend test automation or integration testing, and experience creating end-to-end tests for web UIs.
- Experience with Kubernetes, React, RPC systems such as gRPC, Linux, and CI/CD platforms.
- Familiarity with observability tools such as Prometheus, Alertmanager, or Grafana, and with Kubernetes testing or chaos engineering tools.
- Experience testing LLM-powered or conversational products and building behavioral evaluations is valuable.
- Experience with multicluster tooling, GPU or bare-metal infrastructure, Playwright, or Slack applications is a plus.
Benefits
- Base salary is $180,000 to $200,000 annually.
- On-site position in San Francisco, United States.
- Visa sponsorship is not available.