Cisco

Principal Machine Learning Engineer - CX

Cisco
Apply
3 days ago
San Jose, CA, USAStaff+
H1B sponsor

Base Salary

$296k - $375k/yr

Responsibilities

  • Design and build robust, multi-tenant AI services with scalable APIs, versioning, backward compatibility, and quota management across cloud, on-premises, and air-gapped environments.
  • Select, evaluate, and integrate inference runtimes, orchestration frameworks, and serving technologies for scalable, low-latency AI systems across GPU, CPU, and edge environments.
  • Optimize AI costs through token efficiency, model selection, inference performance, and compute utilization, and establish measurable engineering standards.
  • Lead architecture and design reviews, resolve complex technical trade-offs, mentor senior engineers, and influence platform direction through hands-on technical leadership.
  • Architect and deploy production LLM and SLM inference runtimes, RAG systems, and agentic workflows.
  • Design automated AI evaluation frameworks using golden datasets, LLM-as-a-judge methods, drift detection, and CI/CD regression gates.

Requirements

  • Bachelor’s degree plus 14 years of related experience, or master’s degree plus 11 years, or PhD plus 7 years.
  • Experience designing and building production-grade, multi-tenant distributed systems in Go, Python, or similar, including high-throughput service APIs, asynchronous/event-driven architectures, observability, and reliability engineering at scale.
  • Experience architecting and deploying production LLM or SLM inference runtimes optimized with continuous batching, KV-cache management, or speculative decoding.
  • Experience architecting and deploying production RAG systems and agentic workflows using vector databases.
  • Experience designing and implementing automated evaluation frameworks for AI systems.
  • Preferred experience contributing to open-source inference, serving, or agent-orchestration projects such as vLLM, SGLang, Triton, and LangGraph.
  • Preferred hands-on experience optimizing inference for CPU, NPU, small GPU, and on-premises appliance environments.

Benefits

  • Hybrid work arrangement requiring three days per week onsite in San Jose, California.
  • Base salary range of $296,300 to $374,800 for U.S. and/or Canada locations, with additional location-specific ranges stated in the posting.
  • Medical, dental, and vision insurance; 401(k) matching; paid parental leave; disability coverage; and basic life insurance.
  • Potential Cisco restricted stock unit grants and annual bonuses for non-sales roles.
  • Paid holidays, floating holiday, birthday leave, year-end shutdown, wellness days, vacation or flexible vacation time, sick leave, family emergency leave, and optional paid volunteer days.
Cisco

About Cisco

10,000+ employees

Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.

Contact me