Staff Machine Learning Engineer
ServiceNow1 day ago
Base Salary
$176k - $308k/yr
Responsibilities
- Own the design and technical direction of production agentic systems, including state management, tool boundaries, prompt/context architecture, and multi-agent coordination.
- Lead the evolution of the Harness agent execution runtime, including full-duplex sessions, streaming, backpressure, live progress, partial results, and graceful cancellation.
- Build and operate LangGraph/LangChain agents for transaction editing, conversational configuration, and multi-product quote planning.
- Design and maintain MCP and A2A integrations for platform interoperability and agent-to-agent delegation.
- Develop RAG and context-engineering workflows for tenant document ingestion, categorization, aggregation, and prompt caching.
- Work with async Python services and unblock end-to-end integrations across Spring Boot/Java services and React/TypeScript/Lit frontends.
- Evaluate and extend classical ML training and serving pipelines when LLMs are not the best fit.
- Work directly with customers and product-facing teams on live deployments and real-world workflows.
Requirements
- 8+ years of experience building production software, including several years shipping LLM-powered or agentic systems.
- Deep hands-on experience with LangGraph and/or LangChain, or demonstrated judgment in building custom agent runtimes.
- Strong understanding of MCP, ideally including experience building an MCP server.
- Production async Python experience with FastAPI, asyncio, WebSockets, streaming, and long-lived stateful connections.
- Experience making architecture decisions for agent systems involving tool boundaries, context/state design, cost and latency tradeoffs, and bounded versus autonomous agents.
- Ability to read or modify Spring Boot services and React components, with broader full-stack fluency beyond Python.
- Experience setting technical direction amid ambiguity and operating at a Staff-level judgment bar.
- Demonstrated ability to track new agent frameworks, protocol standards, and model capabilities and apply them in production.
- Ability and willingness to develop fluency in the Core ServiceNow platform and work directly with customers and deployments.
- Preferred experience with PyTorch, scikit-learn, A2A or other agent interoperability protocols, RAG, knowledge-graph systems, embeddings, vector or graph retrieval, multi-tenant SaaS, CPQ, quoting, transaction/pricing, or Forward Deployed Engineering.
Benefits
- Base pay of $176,100-$308,200 plus equity when applicable, variable/incentive compensation, and benefits.
- Health plans including flexible spending accounts, a 401(k) plan with company match, ESPP, matching donations, flexible time away, and family leave programs.
- Flexible work persona within ServiceNow’s distributed work model, subject to role and location eligibility.
- Regular employee role covering North America and Canada.
Tech Stack
Categories
About ServiceNow
ServiceNow (NYSE: NOW) makes the world work better for everyone. Our cloud-based platform and solutions help digitize and unify organizations so that they can find smarter, faster, better ways to make work flow. So employees and customers can be more connected, more innovative, and more agile. And we can all create the future we imagine. The world works with ServiceNow. For more information, visit www.servicenow.com.