3 days ago
Base Salary
$296k - $375k/yr
Responsibilities
- Design and build robust, multi-tenant AI services with scalable APIs, versioning, backward compatibility, and quota management across cloud, on-premises, and air-gapped environments.
- Select, evaluate, and integrate inference runtimes, orchestration frameworks, and serving technologies for scalable, low-latency AI systems across GPU, CPU, and edge environments.
- Optimize AI costs through token efficiency, model selection, inference performance, and compute utilization, and establish measurable engineering standards.
- Lead architecture and design reviews, resolve complex technical trade-offs, mentor senior engineers, and influence platform direction through hands-on technical leadership.
- Architect and deploy production LLM and SLM inference runtimes, RAG systems, and agentic workflows.
- Design automated AI evaluation frameworks using golden datasets, LLM-as-a-judge methods, drift detection, and CI/CD regression gates.
Requirements
- Bachelor’s degree plus 14 years of related experience, or master’s degree plus 11 years, or PhD plus 7 years.
- Experience designing and building production-grade, multi-tenant distributed systems in Go, Python, or similar, including high-throughput service APIs, asynchronous/event-driven architectures, observability, and reliability engineering at scale.
- Experience architecting and deploying production LLM or SLM inference runtimes optimized with continuous batching, KV-cache management, or speculative decoding.
- Experience architecting and deploying production RAG systems and agentic workflows using vector databases.
- Experience designing and implementing automated evaluation frameworks for AI systems.
- Preferred experience contributing to open-source inference, serving, or agent-orchestration projects such as vLLM, SGLang, Triton, and LangGraph.
- Preferred hands-on experience optimizing inference for CPU, NPU, small GPU, and on-premises appliance environments.
Benefits
- Hybrid work arrangement requiring three days per week onsite in San Jose, California.
- Base salary range of $296,300 to $374,800 for U.S. and/or Canada locations, with additional location-specific ranges stated in the posting.
- Medical, dental, and vision insurance; 401(k) matching; paid parental leave; disability coverage; and basic life insurance.
- Potential Cisco restricted stock unit grants and annual bonuses for non-sales roles.
- Paid holidays, floating holiday, birthday leave, year-end shutdown, wellness days, vacation or flexible vacation time, sick leave, family emergency leave, and optional paid volunteer days.
Categories
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.
