Senior Software Engineer, Agentic Platform - Moveworks
ServiceNow7 hours ago
Responsibilities
- Build and own an agent orchestration engine for long-running sessions spanning planning, execution, user interaction, LLM calls, and tool invocations.
- Design distributed session management using leasing, heartbeats, conditional writes, checkpointing, and crash recovery.
- Develop event-driven message pipelines with ordered delivery, event consumers, and real-time streaming.
- Implement structured concurrency, cancellation, fail-fast behavior, and concurrent task execution.
- Build observability infrastructure with tracing and custom span lifecycle management across asynchronous boundaries.
- Develop Redis and DynamoDB caching and state layers with organizational and bot-level scoping.
- Build MCP and agent-to-agent connectivity, including tool discovery, namespacing, and tool selection.
- Improve agent token efficiency and latency through context engineering, caching, speculative scheduling, and parallel model calls.
- Evaluate and adopt open-weights LLMs by benchmarking accuracy, latency, and cost on agent tasks.
Requirements
- 5+ years of experience building production backend or infrastructure systems.
- Strong Python or Go skills, ideally both.
- Experience designing and operating systems handling real traffic at scale.
- Hands-on experience building production systems that use LLMs or other machine learning models.
- Deep experience in at least three areas including distributed systems, concurrent or asynchronous programming, event-driven architectures, infrastructure database systems, observability, gRPC/protobuf, or machine learning.
- Experience building and shipping LLM products using RAG, chain-of-thought, self-reflection, tool or function calling, and agentic reasoning.
- Experience training, fine-tuning, or evaluating machine learning models on large datasets, particularly for NLP, retrieval, or ranking.
- Experience designing metrics, evaluation datasets, features, and signals to improve relevance, quality, ranking, or model selection.
- Research or applied experience in machine learning, LLMs, agentic systems, information retrieval, or ranking and relevance.
- Comfort working with novel problems and ambiguity.
Benefits
- Regular employee position with a required-in-office work persona in North America and Canada.
- ServiceNow supports flexible, remote, or required-in-office work personas depending on role and location.
- Equal opportunity and reasonable accommodation support are provided.
Tech Stack
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.