4 days ago
Base Salary
$168k - $245k/yr
Responsibilities
- Develop foundations and evaluation frameworks for assessing AI agents, workflows, and system processes.
- Build scalable, maintainable, and high-performance testing infrastructure using Python and Groovy.
- Develop AI-based solutions or agents to mitigate risk and improve system integrity across testing methodologies.
- Implement benchmarking protocols, proof-of-concepts, and validation approaches for testing paradigms.
- Execute LLM-as-judge evaluations, tenant isolation probes, behavioral regression suites, and modern performance testing.
- Participate in code reviews, design reviews, technical collaboration, and validation of technical hypotheses.
Requirements
- Bachelor’s degree plus 8+ years of experience in software development and test automation, including experience building large-scale testing ecosystems.
- Programming experience with Python and Groovy for scalable testing infrastructure.
- Experience with security compliance frameworks and modern performance testing methodologies.
- Experience using AI to build automation, including writing AI skills for test automation.
- Preferred experience with contract testing frameworks, Playwright, OCSF validation libraries, vacuum linter, Caldera, tenant isolation probes, and audit log validation.
- Preferred experience with AI/ML testing using Claude, Codex, LLM APIs, prompt engineering, agentic workflows, LangChain, and LangSmith.
Benefits
- Medical, dental, and vision insurance; 401(k) with Cisco matching contribution; paid parental leave; disability coverage; and basic life insurance.
- Eligible employees may receive Cisco restricted stock units and annual bonuses subject to company policies.
- Paid holidays, floating holidays, birthday leave, year-end shutdown, wellness days, vacation or flexible time off, sick time, family emergency leave, and optional volunteer days are available subject to eligibility and policy.
- The posted U.S. and/or Canada starting salary range is $167,700.00 to $245,200.00, excluding incentive compensation, equity, and benefits.
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.