1 day ago
Durham, NC, USAMid Level
H1B sponsor
Base Salary
$129k - $185k/yr
Responsibilities
- Architect, build, and maintain automated regression and end-to-end test suites for the Circuit platform.
- Design and automate REST and GraphQL API tests for functional correctness, contract validation, error handling, and performance.
- Plan and execute load, stress, and soak tests while tracking response-time, throughput, error-rate, and AI-specific performance metrics.
- Develop testing approaches for AI/LLM features, including model response quality, stability, and end-to-end agent workflows.
- Use Cursor, GitHub Copilot, and Claude Code to generate and maintain tests, validating generated code before merging.
- Integrate automated tests into CI/CD pipelines using GitHub Actions, Jenkins, or equivalent tools.
- Build quality dashboards and reports with Grafana and Allure, and communicate quality metrics, risks, and defect trends.
- Define automation standards, mentor peers, and collaborate with engineering, product, and UX teams.
Requirements
- Bachelor’s degree with 4+ years, Master’s degree with 3+ years, or PhD with 1+ year of related experience in Computer Science, AI/ML, or a related technical field.
- Experience developing test automation and regression frameworks with a strong understanding of functional quality assurance.
- Experience with Playwright and TypeScript/JavaScript for E2E or UI automation, and/or Python with Pytest or Robot Framework; familiarity with Selenium.
- Experience with REST API testing and familiarity with API contract testing; GraphQL testing is a plus.
- Knowledge of software development lifecycles, CI/CD pipelines, and automated testing best practices.
- Experience with AI-assisted coding tools such as GitHub Copilot, Cursor, and Claude Code.
- Preferred experience testing AI/ML-powered applications, LLM features, chatbots, or AI agent workflows.
- Preferred hands-on experience with k6, JMeter, TTFT, inter-token latency, and token throughput metrics.
- Preferred experience with AI Ops/MLOps, custom LLM fine-tuning, Splunk, Grafana, Prometheus, Docker, Kubernetes, and Google Cloud Platform.
- Preferred experience leading technical projects, mentoring junior engineers, and productizing agentic applications with evaluation and business acceptance.
Benefits
- Hybrid work arrangement.
- Medical, dental, and vision insurance, 401(k) with Cisco matching contribution, paid parental leave, disability coverage, and basic life insurance, subject to eligibility.
- Potential Cisco restricted stock unit grants and annual bonuses for non-sales roles, subject to company policies.
- Paid holidays, floating holiday, birthday leave, year-end shutdown, personal wellness days, vacation or flexible time off, and sick time.
- Optional paid volunteer days and additional paid time away for critical family or emergency issues.
Tech Stack
Apache JMeterDockerGitGitHub ActionsGoogle Cloud PlatformGrafanaGraphQLJavaScriptJenkinsKubernetesPrometheuspytestPythonRobot FrameworkSeleniumSplunkTypeScript
Categories
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.