17 hours ago
San Francisco, CA, USAMid Level
Base Salary
$180k - $200k/yr
Responsibilities
- Test conversational workflows end to end, including response accuracy and actions performed on live clusters.
- Build evaluations for AI agent behavior, including safe handling of actions and ambiguous or invalid requests.
- Create end-to-end tests for the web interface and verify consistency across interfaces.
- Write Go integration tests for backend installation, upgrade, and failover workflows.
- Provision and tear down Kubernetes test clusters to validate controllers, operators, and custom resources across Kubernetes versions.
- Verify that alerts reach the correct destinations and fire under appropriate conditions.
- Gate releases through CI and convert bugs and incidents into regression tests.
Requirements
- At least 3 years of experience in QA, SDET, or test automation, including building or delivering test suites and automation frameworks.
- Strong Go skills, including backend test automation or integration testing, and experience creating end-to-end tests for web UIs.
- Experience testing or validating Kubernetes systems and familiarity with Linux and CI/CD platforms.
- Experience with React and RPC protocols such as gRPC.
- Experience with multicluster tooling, Kubernetes testing, chaos engineering, GPUs, or bare-metal infrastructure is beneficial.
- Experience testing conversational or LLM-powered products, building agent evaluations, or testing Slack apps is a plus.
- Knowledge of observability tools such as Prometheus, Alertmanager, or Grafana is useful.
Benefits
- Base salary is $180,000 to $200,000 annually.
- The role is on-site in San Francisco, California.
- Visa sponsorship is not available.