9 days ago
Durham, NC, USAEntry Level / Mid Level
H1B sponsor
Base Salary
$129k - $185k/yr
Responsibilities
- Architect, build, and maintain automated regression and end-to-end test suites for the Circuit platform.
- Develop REST and GraphQL API tests covering functional correctness, contract validation, error handling, and performance.
- Plan and execute load, stress, and soak testing while tracking response-time percentiles, throughput, error rates, TTFT, and inter-token latency.
- Use AI agents and AI-assisted coding tools to generate and maintain tests, and validate generated code for stability, correctness, and security compliance.
- Test AI/LLM features, model-serving endpoints, AI agent workflows, response quality, and behavioral consistency.
- Integrate automated tests into CI/CD pipelines and build quality dashboards and reports.
- Lead automation initiatives as a Team Captain, define standards, mentor peers, and collaborate with development, product, and UX teams.
Requirements
- Bachelor’s degree with 4+ years, master’s degree with 3+ years, or PhD with 1+ year of related experience in Computer Science, AI/ML, or a related technical field.
- Experience developing test automation and regression frameworks with a strong understanding of functional quality assurance.
- Experience with Playwright and TypeScript/JavaScript for E2E/UI automation and/or Python with Pytest or Robot Framework; familiarity with Selenium.
- Experience with REST API testing.
- Knowledge of software development lifecycles, CI/CD pipelines, and automated testing best practices.
- Experience with GitHub Copilot, Cursor, Claude Code, or similar AI-assisted coding tools.
- Preferred experience testing AI/ML-powered web applications, LLM features, chatbots, or AI agent workflows.
- Preferred hands-on experience with k6, JMeter, TTFT, inter-token latency, token throughput, AI Ops/MLOps, custom LLMs, observability, Docker, Kubernetes, GCP, and agentic application evaluation.
- Preferred experience leading technical projects and mentoring junior engineers, plus strong communication and cross-functional collaboration skills.
Benefits
- Hybrid work arrangement.
- Medical, dental, and vision insurance.
- 401(k) plan with Cisco matching contribution.
- Paid parental leave, short- and long-term disability coverage, and basic life insurance.
- Potential Cisco restricted stock unit grants.
- Paid holidays, floating holiday, birthday leave, year-end shutdown, wellness days, vacation, sick time, and optional volunteer days.
- Eligibility for annual bonuses for non-sales roles.
Tech Stack
Apache JMeterDockerGitHub ActionsGoogle Cloud PlatformGrafanaGraphQLJavaScriptJenkinsKubernetesPrometheuspytestPythonRobot FrameworkSeleniumSplunkTypeScript
Categories
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.