27 days ago
Remote, United StatesStaff+
Base Salary
$170k - $276k/yr
Responsibilities
- Set technical direction for the AI Gateway’s model router, MCP gateway, control plane, and core systems.
- Own complex problems including dynamic model selection, auto-failover, cost-based routing, policy enforcement, credential storage, session summarization, caching, and rate limiting.
- Build infrastructure for evaluating, replaying, and backtesting agent and LLM behavior.
- Define abstractions across model and tool providers including OpenAI, Anthropic, Google, and AWS Bedrock.
- Architect secure identity and credential vaulting for enterprise-scale tool and model access.
- Build real-time and historical analytics for AI agent behavior and ensure end-to-end policy enforcement and logging.
- Improve developer experience through intuitive APIs and observability capabilities.
- Identify systemic gaps and drive fixes across architecture, process, and tooling.
- Mentor senior and mid-level engineers through code, design reviews, and technical example.
- Partner with product, design, and leadership to shape the control-plane product and technical strategy.
Requirements
- 8+ years of backend engineering experience owning production-grade systems at significant scale.
- Deep specialization in distributed systems, cloud-native infrastructure, and API design.
- Experience building secure, high-throughput services such as gateways, proxies, load balancers, or policy engines.
- Fluency in Go and/or Rust.
- Demonstrated ability to identify systemic gaps and drive fixes across team boundaries.
- Strong product mindset and experience shaping technical direction.
- Ability to operate autonomously with broad latitude in solving complex problems.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Prior experience with OpenAI, Anthropic, or similar LLM APIs is a bonus.
- Familiarity with RAG architectures, vector databases, agent frameworks, policy engines, observability frameworks, or API gateways is a bonus.
- Understanding of OAuth 2.1, secret management, and cloud IAM systems is a bonus.
- Experience with Kubernetes, Docker, and microservices architecture is a bonus.
- Experience setting technical standards adopted by other teams or engineers is a bonus.
Benefits
- Remote-first work from anywhere, with offices in Seattle and Paris for connection and collaboration.
- Flexible scheduling and autonomy over work hours.
- Generous paid time off, quarterly Whaleness Days, and an end-of-year Whaleness break.
- Home office support.
- Technology stipend equivalent to US$100 net per month.
- Annual stipend for conferences, courses, certifications, and continued learning.
- 16 weeks of paid parental leave after six months of employment.
- Equity for all full-time employees.
- Medical, retirement, and paid holiday benefits that vary by country.
- Docker swag.
Tech Stack
Categories
About Docker
Docker builds developer tools for building, sharing, and running containerized applications, including Docker Desktop, Docker Hub, Docker Scout, and the open-source Docker Engine. It monetizes through paid subscriptions for individuals, teams, and enterprises, along with security offerings such as Docker Hardened Images. Founded in 2013 and headquartered in San Francisco, the company serves over 20 million monthly users and supports more than 20 billion container image pulls.