2 days ago
Durham, NC, USAMid Level
H1B sponsor
Base Salary
$129k - $185k/yr
Responsibilities
- Develop and operate production services for Cisco’s foundational model platform on Kubernetes and Linux.
- Support model onboarding, releases, deployment validation, monitoring, and production debugging.
- Serve models using vLLM, NVIDIA NIM, Triton, or comparable inference runtimes and build supporting services.
- Participate in a shared on-call rotation for a critical service with a 99.9% uptime SLA.
- Create technical and end-user documentation and contribute to design, product, and engineering collaboration.
- Lead technical work, mentor engineers, and apply agentic solutions to detect and remediate operational issues automatically.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, or a related field with 3 years of related experience; master’s degree with 1 year of related experience; PhD; or equivalent practical work experience.
- Experience developing and operating production services on Kubernetes and Linux, including exposure to GPU-based AI infrastructure.
- Hands-on experience serving models with vLLM, NVIDIA NIM, Triton, or a comparable inference runtime, including building supporting services.
- Experience leading technical work, mentoring engineers, documenting systems, and supporting critical services through an on-call rotation.
- Preferred: experience evaluating and benchmarking models for production release decisions.
- Preferred: experience operating GPU workloads with NVIDIA CUDA or AMD ROCm.
- Preferred: familiarity with distributed inference, disaggregated serving, KV-cache-aware routing, capacity planning, or cost optimization.
- Preferred: experience fine-tuning transformer models or evaluating RAG and agent systems using relevant frameworks.
Benefits
- Starting salary range is $128,600.00 to $184,900.00, excluding incentive compensation, equity, and benefits.
- Benefits may include medical, dental, vision, 401(k) matching, paid parental leave, disability coverage, and basic life insurance.
- Employees may be eligible for Cisco restricted stock unit grants and annual bonuses for non-sales roles.
- Paid time off includes holidays, birthday leave, year-end shutdown, wellness days, vacation or flexible vacation, sick time, family emergency leave, and optional volunteer days.
- The application window is expected to close on 10/29/2026, though the posting may be removed earlier.
Tech Stack
Categories
About Cisco
Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.