2 days ago
Base Salary
$129k - $185k/yr
Responsibilities
- Architect, build, and maintain automated regression and end-to-end test suites for the Circuit platform.
- Design and automate REST and GraphQL API tests for functional correctness, contract validation, error handling, and performance.
- Plan and execute load, stress, and soak testing while tracking response-time, throughput, error, and AI-specific performance metrics.
- Use AI-assisted coding tools to generate and maintain tests and validate the resulting artifacts before merge.
- Develop validation strategies for AI/LLM features, including model response quality, behavioral stability, and end-to-end agent workflows.
- Integrate automated tests into CI/CD pipelines and build quality dashboards and reports.
- Communicate quality metrics, risk assessments, and defect trends to engineering leadership.
- Lead automation initiatives, define standards, mentor peers, and collaborate with development, product, and UX teams.
Requirements
- Bachelor’s degree with 4+ years, Master’s degree with 3+ years, or PhD with 1+ year of related experience in Computer Science, AI/ML, or a related technical field.
- Experience developing test automation and regression frameworks with a strong understanding of functional quality assurance.
- Experience with Playwright and TypeScript/JavaScript for E2E/UI automation and/or Python with Pytest or Robot Framework, plus familiarity with Selenium.
- Experience with REST API testing and familiarity with API contract testing; GraphQL testing is a plus.
- Knowledge of software development lifecycles, CI/CD pipelines, and automated testing best practices.
- Experience with AI-assisted coding tools such as GitHub Copilot, Cursor, or Claude Code.
- Preferred experience testing AI/ML-powered web applications, LLM features, chatbots, or AI agent workflows.
- Preferred hands-on experience with k6 or JMeter and AI/LLM performance metrics.
- Preferred experience in AI Ops/MLOps or building and fine-tuning custom LLMs.
- Preferred experience with Splunk, Grafana, Prometheus, Docker, Kubernetes, and Google Cloud Platform.
- Proven ability to lead technical projects, mentor junior engineers, communicate effectively, and influence cross-functional stakeholders.
- Preferred experience building and productizing agentic applications with evaluation and business acceptance in mind.
Benefits
- Hybrid work arrangement.
- Starting salary range of $128,600.00 to $184,900.00, excluding incentive compensation, equity, and benefits.
- Medical, dental, and vision insurance, a 401(k) plan with Cisco matching, paid parental leave, disability coverage, and basic life insurance, subject to eligibility.
- Potential eligibility for Cisco restricted stock unit grants.
- Paid holidays, floating holiday, birthday day off, year-end shutdown, wellness days, vacation or flexible vacation, sick time, family emergency leave, and optional volunteer days, subject to applicable policies.
- Annual bonus eligibility for non-sales roles, subject to Cisco policies.
Tech Stack
Apache JMeterDockerGitHub ActionsGoogle Cloud PlatformGrafanaGraphQLJavaScriptJenkinsKubernetesPrometheuspytestPythonRobot FrameworkSeleniumSplunkTypeScript
Categories
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.