7 months ago
Responsibilities
- Build and evolve Cursor’s inference gateway as a unified abstraction over provider API semantics.
- Design intelligent cross-provider failover to reduce user-visible degradation during provider outages.
- Design routing backpressure and admission control to prevent traffic spikes from cascading into providers.
- Build and operate production inference systems handling millions of requests.
- Balance reliability, cost, latency, and user experience in large-scale system design decisions.
Requirements
- Deep experience building high-throughput, low-latency distributed systems.
- Particularly strong experience in inference serving, traffic routing, or real-time data pipelines.
- Ability to reason about GPU utilization, provider economics, and capacity planning at scale.
- Strong software engineering fundamentals and experience shipping production systems handling millions of requests.
- Ability to make sound tradeoffs among reliability, cost, latency, and user experience.
Categories
About Cursor
Cursor is an AI-powered code editor and coding assistant from Anysphere, built for professional software engineers and enterprise teams. It combines a VS Code–style editor with integrated AI chat, code generation, and repo-aware refactoring, and is sold via individual, team, and enterprise subscriptions. The company also targets sectors like healthcare and state and local education with field engineers who support evaluations and proofs of concept.