Staff Machine Learning Engineer
ServiceNow2 days ago
Base Salary
$176k - $308k/yr
Responsibilities
- Design and build the agent execution harness for routing inputs, managing context, invoking tools, handling retries, and exposing execution state across multi-step agent workflows.
- Own runtime fault tolerance, latency, throughput, and reliability for enterprise workflows.
- Build tracing, cost attribution, latency visibility, prompt management, and systematic prompt evaluation systems.
- Design and own unit, integration, and production evaluation frameworks that measure agent quality and catch regressions.
- Integrate and abstract over frontier LLMs, including model routing, fallback strategies, cost management, and latency tradeoffs.
- Set technical standards through architecture decisions, code reviews, coaching, and agentic design guidance.
- Define system boundaries between tool calls, sub-agents, hardcoded paths, and human escalation.
Requirements
- 7+ years building production software systems with a strong track record in reliability, performance, and scalability.
- Hands-on experience shipping generative AI products that production users depend on.
- Strong understanding of large language model failure modes, context constraints, and prompt design.
- Experience with Python, Kubeflow, SageMaker, Vertex AI or AzureML, and SQL.
- Practical experience systematically designing, versioning, and evaluating prompts.
- Demonstrated experience designing and shipping evaluation suites used for production quality decisions.
- Experience reasoning about model routing, inference cost, and latency tradeoffs.
- Strong software engineering fundamentals in distributed systems, API design, and testing.
- Comfort working in fast-moving, ambiguous AI product environments.
- Experience with multi-agent coordination patterns such as A2A and MCP is preferred.
- Familiarity with LangChain, LlamaIndex, enterprise AI systems, AI observability tooling, cloud-native infrastructure, logging, monitoring, reliability engineering, and production troubleshooting is preferred.
Benefits
- Base pay of $176,100 - $308,200, plus equity when applicable, variable or incentive compensation, and benefits.
- Health plans including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, flexible time away, and family leave programs.
- Flexible, remote, or required-in-office work personas depending on the role and location.
- Regular employee position in the North America and Canada region with a flexible work persona.
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.