Senior Staff Machine Learning Engineer - DevOps
ServiceNow5 hours ago
Base Salary
$201k - $352k/yr
Responsibilities
- Lead the architecture, optimization, and operational excellence of the AI inference platform.
- Own the inference lifecycle from onboarding models to deploying optimized inference engines across multiple production backends.
- Deploy, scale, and operate services in Kubernetes using Helm and repeatable release pipelines.
- Architect an intelligent Envoy and ext_proc gateway for access control, observability, and advanced request routing.
- Own metrics, logs, tracing, and customer-impact-focused alerting for production services.
- Debug and resolve production incidents, participate in on-call, conduct root-cause analysis, and operate against service level objectives.
- Build efficient, modular, object-oriented software and apply AI-assisted debugging and trace analysis responsibly.
Requirements
- 8+ years of backend software engineering experience.
- 4+ years of experience designing and operating distributed systems.
- 3+ years of production Kubernetes experience, including Helm and CI/CD.
- Expertise in Go or Python, object-oriented programming, design patterns, and efficient algorithms.
- Experience building products that use challenging algorithms and writing efficient, quality software.
- Knowledge of core AI/ML techniques and algorithms, unit testing, profiling, and code tuning.
- Bachelor’s degree in computer science, software engineering, or a closely related technical field.
- A master’s degree may offset up to one year of the experience minimum; equivalent practical experience is considered where technical depth is clearly demonstrable.
- Ability to use and critically review AI coding assistants such as GitHub Copilot or Cursor, including awareness of data privacy rules for prompts.
Benefits
- Base pay of $201,300-$352,300 plus equity when applicable, variable or incentive compensation, and benefits.
- Health plans including flexible spending accounts, a 401(k) plan with company match, ESPP, matching donations, flexible time away, and family leave programs.
- Flexible work persona with a requirement to work from the Santa Clara office two days per week.
Tech Stack
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.