Senior Staff (DevOps) Machine Learning Engineer
ServiceNow12 hours ago
Base Salary
$201k - $352k/yr
Responsibilities
- Lead the architecture, optimization, and operational excellence of the AI inference platform.
- Own the inference lifecycle from model onboarding through deployment of optimized inference engines across multiple production backends.
- Deploy, scale, and operate services in Kubernetes environments using Helm-based deployments and repeatable CI/CD pipelines.
- Architect an Envoy and ext_proc gateway layer for access control, observability, and advanced request routing.
- Own metrics, logs, tracing, and customer-impact-focused alerting for production services.
- Debug and resolve production incidents, participate in on-call rotations, and conduct root-cause analysis against defined service level objectives.
Requirements
- Expertise in Go or Python, object-oriented programming, design patterns, efficient algorithms, and modular software development.
- Experience building products involving challenging algorithms and knowledge of core AI/ML techniques.
- Knowledge of unit testing, profiling, and code tuning.
- Experience deploying and operating production services on Kubernetes, including Helm and CI/CD.
- Experience with distributed systems, GPU compute, LLM APIs, inference frameworks, containerization, orchestration, and API gateway architecture.
- 8+ years of backend software engineering experience.
- 4+ years of experience designing and operating distributed systems.
- 3+ years of production Kubernetes experience, including Helm and CI/CD.
- Bachelor’s degree in computer science, software engineering, or a closely related technical field.
- A master’s degree may offset up to one year of the experience minimum, and equivalent practical experience may be considered where technical depth is clearly demonstrated.
- Ability to use and critically review AI coding assistants such as GitHub Copilot or Cursor, apply AI-assisted debugging and trace analysis, and understand prompt data privacy rules.
Benefits
- Base pay is listed at $201,300–$352,300, plus equity when applicable, variable or incentive compensation, and benefits.
- Benefits include health plans, flexible spending accounts, a 401(k) plan with company match, ESPP, matching donations, flexible time away, and family leave programs.
- The role has a flexible work persona within ServiceNow’s distributed work model.
- Employee type is regular.
Tech Stack
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.