6 days ago
Base Salary
$187k - $268k/yr
Responsibilities
- Define and oversee the architectural roadmap for PQ foundations and evaluation frameworks supporting AI agents, complex workflows, and system processes.
- Identify testing gaps and lead AI-based automation solutions to mitigate risk and improve system integrity.
- Mentor engineers, conduct architectural reviews, and guide validation of complex technical hypotheses.
- Govern proof-of-concept experimentation and establish standards for validating novel testing approaches.
- Manage quality ecosystems that deliver reliable outcomes at enterprise scale.
- Set standards for LLM-as-judge methodologies, tenant isolation probes, behavioral regression suites, contract testing, and audit log validation.
- Collaborate with engineering leadership on security compliance and quality integration across the development lifecycle.
Requirements
- Bachelor’s degree and 10+ years of experience in software development and test automation, including architecting large-scale testing ecosystems.
- Programming experience with Python and Go and the ability to design scalable, maintainable, high-performance testing infrastructure.
- Experience with security compliance frameworks and modern performance testing methodologies.
- Experience using AI to build test automation, including writing AI skills for automation.
- Preferred experience with contract testing frameworks, Playwright, OCSF validation libraries, vacuum linter, Caldera, tenant isolation probes, and audit log validation.
- Preferred expertise with LLM APIs such as Claude and Codex, prompt engineering, agentic workflows, LangChain, LangSmith, AI behavioral regression, and LLM-as-judge frameworks.
- Preferred experience with K6, Terra VM Security Suite, and JMeter.
Benefits
- Medical, dental, and vision insurance; 401(k) with Cisco matching contribution; paid parental leave; disability coverage; and basic life insurance.
- Eligibility for Cisco restricted stock unit grants and annual bonuses for non-sales roles.
- Paid holidays, floating holidays, birthday and wellness days, year-end shutdown, vacation or flexible time off, and sick time.
- Additional paid time away for critical family or emergency issues and up to 10 paid volunteer days per year.
- Application window is expected to close September 17, 2026, though the posting may close earlier if the position is filled or enough applications are received.
About Cisco
Cisco is the worldwide technology leader that is revolutionizing the way organizations connect and protect in the AI era. For more than 40 years, Cisco has securely connected the world. With its industry leading AI-powered solutions and services, Cisco enables its customers, partners and communities to unlock innovation, enhance productivity and strengthen digital resilience. With purpose at its core, Cisco remains committed to creating a more connected and inclusive future for all.