Senior Staff Software Engineer, ML Infrastructure - Moveworks
ServiceNow3 hours ago
Responsibilities
- Build and own the distributed runtime infrastructure and agent orchestration engine powering AI agents at enterprise scale.
- Implement distributed session management using DynamoDB leases, heartbeats, conditional writes, and checkpoint-based crash recovery.
- Develop event-driven pipelines using SQS FIFO, Kafka, gRPC, and Socket.IO for ordered delivery and real-time streaming.
- Build structured-concurrency workflows with Python asyncio TaskGroups or Go concurrency patterns, including cancellation and fail-fast behavior.
- Develop observability infrastructure with OpenTelemetry, distributed trace propagation, custom span management, and Prometheus metrics.
- Maintain caching and state layers using Redis and DynamoDB with scoped storage, batch-read optimization, and hot-reload configuration.
Requirements
- 12+ years building production backend or infrastructure systems.
- Strong proficiency in Python or Go, ideally both.
- Deep experience in at least three areas including distributed systems, concurrent or asynchronous programming, event-driven architectures, infrastructure database systems, observability, or gRPC/protobuf.
- Experience designing and operating systems handling real traffic at scale.
- Experience with consistency models, idempotency, delivery guarantees, distributed locking or leasing, cancellation handling, and backpressure as applicable to the selected expertise areas.
- U.S. citizen or permanent resident status.
- Comfort working through ambiguous problems without established textbook solutions.
Benefits
- Regular employee position.
- Required-in-office work persona; ServiceNow describes work personas as flexible, remote, or required in office depending on role and location.
- ServiceNow offers an accessible and inclusive workplace with reasonable accommodation support.
Tech Stack
Categories
About ServiceNow
ServiceNow (NYSE: NOW) makes the world work better for everyone. Our cloud-based platform and solutions help digitize and unify organizations so that they can find smarter, faster, better ways to make work flow. So employees and customers can be more connected, more innovative, and more agile. And we can all create the future we imagine. The world works with ServiceNow. For more information, visit www.servicenow.com.