1 day ago
Base Salary
$139k - $204k/yr
Responsibilities
- Architect, build, and maintain automated regression and end-to-end test suites for the Circuit platform.
- Develop REST and GraphQL API tests for functional correctness, contracts, error handling, performance, and AI/model-serving endpoints.
- Plan and execute load, stress, and soak tests while tracking response-time percentiles, throughput, error rates, TTFT, and inter-token latency.
- Use Cursor, Copilot, and Claude Code to generate and maintain tests, while validating generated code for stability, correctness, and security compliance.
- Create testing strategies for AI/LLM features, including response quality, stability, and end-to-end agent workflows.
- Integrate automated tests into CI/CD pipelines and build Grafana and Allure quality dashboards and reports.
- Communicate quality metrics, risk assessments, and defect trends to engineering leadership.
- Act as a Team Captain by defining automation standards, mentoring peers, and collaborating with development, product, and UX teams.
Requirements
- Bachelor’s degree with 7+ years, master’s degree with 4+ years, or PhD with 1+ year of related experience in Computer Science, AI/ML, or a related technical field.
- Experience developing test automation and regression frameworks with strong functional QA knowledge.
- Experience with Playwright and TypeScript/JavaScript and/or Python with Pytest or Robot Framework; familiarity with Selenium.
- Experience testing REST APIs and familiarity with API contract testing; GraphQL testing is a plus.
- Knowledge of software development lifecycles, CI/CD pipelines, and automated testing best practices.
- Experience with AI-assisted coding tools such as GitHub Copilot, Cursor, or Claude Code.
- Experience testing AI/ML-powered applications, LLM features, chatbots, or AI agent workflows is preferred.
- Hands-on performance/load testing experience with k6 or JMeter and familiarity with AI/LLM performance metrics is preferred.
- Experience with AI Ops/MLOps or building and fine-tuning custom LLMs is preferred.
- Experience with observability and reporting tools such as Splunk, Grafana, and Prometheus is preferred.
- Familiarity with Docker, Kubernetes, and Google Cloud Platform is preferred.
- Proven technical project leadership, mentoring, communication, collaboration, and cross-functional influence skills.
- Experience building and productizing agentic applications with a focus on evaluation and business acceptance is preferred.
Benefits
- Hybrid work arrangement.
- Medical, dental, and vision insurance, 401(k) with Cisco matching contributions, paid parental leave, disability coverage, and basic life insurance, subject to eligibility.
- Potential Cisco restricted stock unit grants and annual bonuses for non-sales roles, subject to company policies.
- Paid holidays, floating holiday, birthday day off, year-end shutdown, wellness days, vacation or flexible vacation time, and sick time, subject to applicable policies.
- Up to 10 paid volunteer days per year and additional paid time away for critical or emergency family issues.
Tech Stack
Apache JMeterDockerGitGitHub ActionsGoogle Cloud PlatformGrafanaGraphQLJavaScriptJenkinsKubernetesPrometheuspytestPythonRobot FrameworkSeleniumSplunkTypeScript
Categories
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.
