5 days ago
Base Salary
$296k - $375k/yr
Responsibilities
- Design and build robust, multi-tenant AI platform services with scalable APIs, versioning, backward compatibility, and quota management.
- Select, evaluate, and implement models, frameworks, inference runtimes, and orchestration technologies across GPU, CPU, edge, cloud, on-premises, and air-gapped environments.
- Develop, fine-tune, and optimize AI models and production LLM or SLM inference runtimes.
- Architect and deploy production RAG systems, agentic workflows, and AI platform APIs.
- Design automated evaluation frameworks using golden datasets, LLM-as-a-judge methods, drift detection, and regression gates.
- Improve token efficiency, model selection, inference performance, and compute utilization to establish AI cost-efficiency standards.
- Lead architecture and design reviews, resolve technical trade-offs, mentor senior engineers, and influence platform direction.
Requirements
- Bachelor’s degree plus 14 years, master’s degree plus 11 years, or PhD plus 7 years of related experience.
- Experience developing, fine-tuning, and optimizing models in Python with PyTorch or JAX, including PEFT, LoRA, quantization, and distillation techniques.
- Experience architecting and deploying production LLM or SLM inference runtimes using continuous batching, KV-cache management, or speculative decoding.
- Experience architecting and deploying production RAG systems and agentic workflows using vector databases.
- Experience designing automated AI evaluation frameworks with golden test datasets, LLM-as-a-judge methodologies, drift detection, or regression gates.
- Experience architecting production AI platform APIs with quota management, versioning, and deployment across hybrid-cloud and air-gapped environments.
- Preferred qualifications include industry contributions through publications, patents, conference presentations, or open-source AI/ML projects.
- Preferred experience includes optimizing inference for CPUs, NPUs, small GPUs, and on-premises hardware appliances.
Benefits
- Hybrid schedule requiring three days per week onsite in San Jose, California.
- Base salary range of $296,300.00 to $374,800.00 for U.S. and/or Canada locations, excluding incentive compensation, equity, and benefits.
- Medical, dental, and vision insurance; 401(k) with Cisco matching; paid parental leave; disability coverage; and basic life insurance.
- Paid holidays, birthday time off, year-end shutdown, wellness days, vacation or flexible vacation, sick time, family emergency leave, and optional volunteer days.
- Eligibility for annual bonuses, Cisco restricted stock units, and additional benefits subject to applicable policies and plan eligibility.
Categories
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.