
Senior Staff Machine Learning Engineer - DevOps
ServiceNow2 months ago
Base Salary
$201k - $352k/yr
Responsibilities
- Lead the architecture, optimization, and operational excellence of the AI inference platform.
- Own the inference lifecycle from model onboarding through optimized production deployment across multiple backends.
- Deploy, scale, and operate services in production Kubernetes environments using Helm-based deployments and repeatable release pipelines.
- Architect an intelligent gateway layer using Envoy and ext_proc for access control, observability, and advanced request routing.
- Implement meaningful metrics, logs, tracing, and customer-impact-focused alerts.
- Independently debug and resolve production incidents, participate in on-call, conduct root-cause analysis, and operate against defined service-level objectives.
- Build efficient, modular, object-oriented software and use AI-assisted coding and debugging responsibly while protecting prompt data privacy.
Requirements
- 8+ years of backend software engineering experience.
- 4+ years of experience designing and operating distributed systems.
- 3+ years of Kubernetes experience in production, including Helm and CI/CD.
- Expertise in Go or Python, object-oriented programming, design patterns, and time- and space-efficient algorithms.
- Experience building products using challenging algorithms and applying core AI/ML techniques.
- Knowledge of unit testing, profiling, and code tuning.
- Bachelor’s degree in computer science, software engineering, or a closely related technical field.
- A master’s degree may offset up to one year of the experience minimum; equivalent practical experience is considered when technical depth is clearly demonstrable.
- Ability to use and critically review AI coding assistants such as GitHub Copilot or Cursor, perform AI-assisted debugging and trace analysis, and understand data privacy rules for prompts.
Benefits
- Base pay is $201,300 - $352,300, plus equity when applicable, variable or incentive compensation, and benefits.
- Health plans including flexible spending accounts, a 401(k) plan with company match, ESPP, matching donations, flexible time away, and family leave programs.
- Flexible work persona with two days per week required in the Santa Clara office.
- Regular employee position.
Tech Stack
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.