10 days ago
San Jose, CA, USASenior
Base Salary
$170k - $400k/yr
Responsibilities
- Design and build high-concurrency backend services for agent orchestration, tool execution, and real-time streaming.
- Develop failure handling, retry logic, and state management for long-running agentic workflows.
- Architect foundational APIs and services including memory retrieval systems and sandboxed execution environments.
- Optimize systems for low-latency streaming and high-throughput data processing.
- Own features from low-level design and prototyping through production deployment, monitoring, and performance tuning.
- Implement instrumentation and automated evaluation frameworks to track system health and model-quality regressions.
Requirements
- At least 5 years of experience building mission-critical backend systems.
- Expertise in concurrency, networking protocols, distributed systems, horizontal scaling, and production operations.
- Track record of shipping APIs and infrastructure that handle real-world traffic.
- Experience integrating LLMs into backend pipelines and handling non-deterministic system failure modes.
- Strong experience with at least one systems-level language: Go, Rust, C++, or Java.
- Comfort with cloud-native architectures, AWS or GCP, container orchestration, and secure isolated execution sandboxes.
- Ability to communicate architectural tradeoffs and collaborate with model researchers.
- Bonus: experience with gRPC, WebSockets, vector databases, distributed caching, custom memory management systems, Kubernetes, microservices security, serverless execution patterns, or developer-facing APIs and SDKs.
Benefits
- Full-time position.
Tech Stack
Categories
