Software Engineer, Platform
Arena Intelligence, Inc.2 months ago
Responsibilities
- Build low-latency, high-reliability API products for leaderboards, models, and arenas.
- Implement streaming responses across heterogeneous model providers, including partial-failure recovery, mid-stream fallback, and response normalization.
- Develop enterprise infrastructure for rate limiting, authentication, usage metering, cost attribution, audit logging, and SOC 2 compliance.
- Instrument systems with distributed tracing, latency analysis, token-level usage tracking, and real-time dashboards.
- Integrate the platform with Arena data, customer benchmarks, and evaluation systems in collaboration with researchers.
- Contribute to the backend of the Leaderboards and Evals platforms and help unify public and private data architectures.
Requirements
- Approximately 5+ years of backend engineering experience with meaningful work in distributed systems, infrastructure, or developer-facing platforms.
- Strong proficiency in Go, which is the primary backend language and a required skill.
- Experience with LLM provider APIs and challenges such as streaming, token management, rate limits, and provider-specific behavior.
- Demonstrated delivery of meaningful backend systems; extensive end-to-end ownership is relevant for staff-level scope.
- Product-oriented approach to API and developer experience design.
- Comfort working in an ambiguous, fast-moving startup environment.
- Preferred experience includes AWS, GCP, or Azure; Kubernetes; Terraform; Postgres; Redis; API gateways or developer tools; AI/ML infrastructure; model serving; enterprise features; billing infrastructure; and modern AI infrastructure tools.
Benefits
- Competitive compensation and equity aligned with the markets where employees are based; the base salary range depends on permanent work location.
- Comprehensive medical, dental, vision, and additional health and wellness support programs.
- Opportunity to work on cutting-edge AI with a small, mission-driven team.
- San Francisco-based role with a minimum of three days per week onsite; fully remote candidates require a very strong endorsement.
- Inclusive culture emphasizing transparency, trust, community impact, and equal employment opportunity.
Tech Stack
About Arena Intelligence, Inc.
Created by researchers from UC Berkeley, Arena (formerly LMArena) is a community-powered platform to measure and advance the frontier of AI for real-world use. Tens of millions of builders, researchers, and creative professionals come to Arena to use frontier models and give feedback on their responses, shaping a public leaderboard grounded in real-world use.