Senior Staff (DevOps) Machine Learning Engineer
ServiceNow9 hours ago
Base Salary
$201k - $352k/yr
Responsibilities
- Lead the architecture, optimization, and operational excellence of the AI inference platform.
- Own the end-to-end inference lifecycle, from onboarding models to deploying optimized inference engines across multiple production backends.
- Deploy, scale, and operate services in Kubernetes using Helm-based deployments and repeatable release pipelines.
- Architect the Envoy and ext_proc intelligent gateway layer for access control, observability, and advanced request routing.
- Implement meaningful metrics, logs, tracing, and customer-impact-focused alerts.
- Debug and resolve production incidents, participate in on-call, conduct root-cause analysis, and operate against service level objectives.
- Build efficient, modular, object-oriented software and apply AI-assisted debugging and trace analysis responsibly.
Requirements
- 8+ years of backend software engineering experience.
- 4+ years of experience designing and operating distributed systems.
- 3+ years of production Kubernetes experience, including Helm and CI/CD.
- Expertise in Go or Python, object-oriented programming, design patterns, and efficient algorithms.
- Knowledge of core AI/ML techniques and algorithms, unit testing, profiling, and code tuning.
- Experience building products that use challenging algorithms and writing efficient, high-quality software.
- Bachelor’s degree in computer science, software engineering, or a closely related technical field; equivalent practical experience may be considered, and a master’s degree may offset up to one year of experience.
- Ability to use and critically review AI coding assistants such as GitHub Copilot or Cursor, including attention to logic errors, security anti-patterns, edge cases, and data privacy.
Benefits
- Base pay of $201,300–$352,300 plus equity when applicable, variable/incentive compensation, and benefits.
- Health plans including flexible spending accounts, a 401(k) plan with company match, ESPP, matching donations, flexible time away, and family leave programs.
- Flexible work persona with a requirement to work from the Santa Clara office two days per week.
- Regular employee position in the AMS—North America and Canada region.
Tech Stack
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.