Senior Software Engineer – AI Quality & Test Automation | Security - Python | Golang | Test Automation LLM APIs | Agentic Workflows (8 - 12 Years)
Cisco16 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Develop PQ foundations and evaluation frameworks for AI agents, workflows, and system processes.
- Implement testing methodologies and AI-based automation solutions to mitigate risk and improve system integrity.
- Build scalable, maintainable, and high-performance testing infrastructure using Python and Go.
- Execute proof-of-concepts and validate testing paradigms and technical hypotheses.
- Implement LLM-as-judge methodologies, tenant isolation probes, and behavioral regression suites.
- Implement contract testing, audit log validation, and security compliance validation with engineering teams.
- Maintain reliable testing processes and participate in code and design reviews.
Requirements
- Bachelor’s degree plus 8+ years of experience in software development and test automation, including large-scale testing ecosystems.
- Programming experience with Python and Go and the ability to design scalable, maintainable, high-performance testing infrastructure.
- Experience with security compliance frameworks and modern performance testing methodologies.
- Experience using AI to build automation and test automation solutions.
- Preferred experience with contract testing frameworks, Playwright, Open Cybersecurity Schema Framework validation libraries, vacuum linter, Caldera, tenant isolation probes, and audit log validation.
- Preferred expertise with LLM APIs including Claude and Codex, prompt engineering, agentic workflows, LangChain, LangSmith, AI behavioral regression, and LLM-as-judge frameworks.
- Preferred experience with K6, Terra Virtual Machine (Security Suite), and JMeter.
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.