19 hours ago
Bengaluru, IndiaStaff+
Responsibilities
- Develop PQ foundations and evaluation frameworks for AI agents, workflows, and system processes.
- Implement benchmarking protocols, testing methodologies, and AI-based automation solutions.
- Build and maintain scalable, reliable, and high-performance testing infrastructure.
- Execute proof-of-concepts and validate testing paradigms and technical hypotheses.
- Implement LLM-as-judge methodologies, tenant-isolation probes, behavioral regression suites, contract testing, and audit-log validation.
- Collaborate with engineering teams through technical support, code reviews, design reviews, and cross-functional quality initiatives.
- Apply performance testing and security-compliance practices to improve system reliability and integrity.
Requirements
- Bachelor’s degree plus 15+ years of experience in software development and test automation.
- Experience building large-scale testing ecosystems and scalable, maintainable, high-performance testing infrastructure.
- Programming experience with Python and Go.
- Experience with security compliance frameworks and modern performance-testing methodologies.
- Experience using AI to build automation, including writing AI skills for test automation.
- Preferred experience with contract testing frameworks, Playwright, Open Cybersecurity Schema Framework validation libraries, vacuum linter, Caldera, tenant-isolation probes, and audit-log validation.
- Preferred expertise with LLM APIs such as Claude and Codex, prompt engineering, agentic workflows, LangChain, LangSmith, AI behavioral regression, and LLM-as-judge frameworks.
- Preferred experience with K6, Terra Virtual Machine (Security Suite), and JMeter.
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.