27 days ago
Remote, United StatesSenior
Base Salary
$161k - $261k/yr
Responsibilities
- Design and implement core AI Gateway systems, including the model router, MCP gateway, and control plane.
- Build infrastructure for dynamic model routing, auto-failover, cost-based routing, and policy enforcement.
- Develop secure credential storage, session summarization, caching, rate limiting, evaluation, telemetry, replay, and backtesting capabilities.
- Create developer-facing APIs using OpenAI-compatible interfaces and the Model Context Protocol.
- Tune performance and reliability for production-scale gateway traffic.
- Lead architectural decisions, mentor engineers, contribute to roadmap planning, and drive cross-functional technical alignment.
Requirements
- 6+ years of backend engineering experience with production-grade systems.
- Deep knowledge of distributed and highly scalable systems, cloud-native infrastructure, and API design.
- Experience building secure, high-throughput services such as gateways, proxies, load balancers, or policy engines.
- Fluency in Go and/or Rust, with both preferred.
- Familiarity with AI/ML platforms or model-serving infrastructure.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Preferred experience includes OpenAI, Anthropic, or similar LLM APIs; RAG architectures; vector databases; agent frameworks; OPA; OpenTelemetry; API gateways; OAuth2.1; secret management; cloud IAM; Kubernetes; Docker; and microservices.
Benefits
- Remote-first work from anywhere, with offices in Seattle and Paris.
- Flexible scheduling, generous PTO, quarterly and end-of-year Whaleness breaks, and home-office support.
- US$100 net monthly technology stipend and an annual learning and development stipend.
- 16 weeks of paid parental leave after six months of employment.
- Equity for all full-time employees, comprehensive benefits, retirement, medical coverage, and paid holidays varying by country.
- Docker swag and global team collaboration.
Tech Stack
Categories
About Docker
Docker builds developer tools for building, sharing, and running containerized applications, including Docker Desktop, Docker Hub, Docker Scout, and the open-source Docker Engine. It monetizes through paid subscriptions for individuals, teams, and enterprises, along with security offerings such as Docker Hardened Images. Founded in 2013 and headquartered in San Francisco, the company serves over 20 million monthly users and supports more than 20 billion container image pulls.