Senior Software Engineer – AI Quality & Test Automation | Security - Python | Golang | Test Automation | AI/ML Testing | Performance Testing | Security Testing | LLM APIs | Agentic Workflows | LangChain | LangSmith | Contract Testing | Playwright (8 - 12 Years)
Cisco1 day ago
Bengaluru, IndiaSenior / Staff+
Responsibilities
- Develop PQ foundations, benchmarking protocols, and evaluation frameworks for AI agents, workflows, and system processes.
- Build scalable, maintainable, and high-performance testing infrastructure using Python and Go.
- Implement proof-of-concepts, testing methodologies, validation techniques, and AI-based automation solutions.
- Execute LLM-as-judge methodologies, tenant isolation probes, behavioral regression suites, contract testing, and audit log validation.
- Collaborate on code and design reviews, validate technical hypotheses, and support cross-functional quality and security compliance goals.
- Maintain reliable testing processes and quality ecosystems aligned with team performance objectives.
Requirements
- Bachelor’s degree plus 8+ years of experience in software development and test automation, including large-scale testing ecosystems.
- Demonstrated programming experience with Python and Go.
- Experience designing scalable, maintainable, and high-performance testing infrastructure.
- Experience with security compliance frameworks and modern performance testing methodologies.
- Experience using AI to build automation and test automation solutions.
- Preferred experience with contract testing frameworks, Playwright, OCSF validation libraries, vacuum linter, Caldera, tenant isolation probes, and audit log validation.
- Preferred experience with LLM APIs including Claude and Codex, prompt engineering, agentic workflows, LangChain, LangSmith, AI behavioral regression, and LLM-as-judge frameworks.
- Preferred experience with K6, Terra Virtual Machine (Security Suite), and JMeter.
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.