Cisco

Senior Platform Software Engineer – AI/ML & GPU Infrastructure

Cisco
Apply
1 day ago
San Jose, CA, USASenior
H1B sponsor

Base Salary

$168k - $245k/yr

Responsibilities

  • Architect and develop platform control-plane services, APIs, and controllers for multi-cluster lifecycle management, project onboarding, and GPU quota enforcement.
  • Own GPU capacity scheduling and allocation architecture, including fractional GPUs, multi-tenant isolation, workload-aware scheduling, and training-versus-inference placement.
  • Build automated capacity-intake, demand-classification, request-routing, and remediation tooling.
  • Design, build, and scale Kubernetes-based platforms using OpenShift or upstream Kubernetes.
  • Lead design reviews and technical standards for platform services, Kubernetes Operators, Controllers, CRDs, and Go/Python automation.
  • Mentor engineers and improve cloud-native software engineering and platform reliability practices.
  • Drive Infrastructure as Code, GitOps, and CI/CD automation, and participate in on-call, incident response, and postmortem reviews.

Requirements

  • Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical experience.
  • 8+ years of software engineering experience building, architecting, or extending Kubernetes-based platforms or large-scale distributed systems, including technical leadership experience.
  • Strong proficiency in Go or Python and experience architecting platform control-plane services, custom APIs, Kubernetes Controllers, Operators, or CRDs.
  • Hands-on experience with batch and accelerator schedulers such as Kueue, Volcano, Slurm, or custom scheduler plugins for GPU or AI/ML workloads.
  • Deep experience with GPU scheduling, multi-tenant GPU infrastructure, or accelerated compute platforms.
  • Experience designing for reliability and operational excellence using Infrastructure as Code, GitOps, CI/CD, and observability tools such as Splunk, Prometheus, or Grafana.
  • Preferred experience scaling Kubernetes control-plane internals or multi-cluster federation at large scale.
  • Preferred familiarity with NVIDIA or AMD GPU architectures, NVLink, InfiniBand, NCCL, topology-aware placement, and gang scheduling.
  • Preferred experience with model serving, distributed training, workload orchestration, MLOps platforms, Linux kernel tuning, cgroups, or eBPF.
  • Preferred experience leading ambiguous platform initiatives and participating in on-call, incident response, postmortem, and runbook processes.

Benefits

  • Medical, dental, and vision insurance; 401(k) with Cisco matching contribution; paid parental leave; disability coverage; and basic life insurance.
  • Potential eligibility for Cisco restricted stock unit grants and annual bonuses for non-sales roles.
  • Paid holidays, floating holiday, birthday leave, year-end shutdown, wellness days, vacation or flexible vacation time, sick time, family emergency leave, and optional paid volunteer days.

Tech Stack

GoGrafanaKubernetesLinuxOpenShiftPrometheusPythonSplunkTerraform

Categories

Cisco

About Cisco

10,000+ employees

Cisco designs and sells networking, security, and collaboration platforms for enterprises, service providers, and governments, spanning routers and switches, Wi‑Fi, firewalls, zero‑trust, observability, and cloud-managed IT (Meraki) plus Webex. Its business model mixes hardware, software subscriptions, and support/consulting services. Founded in 1984 and headquartered in San Jose, California, Cisco is a public company traded on Nasdaq and serves customers across data centers, campuses, and service provider networks.

Contact me