5 months ago
Responsibilities
- Build secure execution environments for agent-generated code
- Develop identity, authentication, and trust-boundary systems for agents
- Build model routing and orchestration across different model types and environments
- Implement rate limiting, quotas, and resource management for agent workflows
- Create state-management, memory, and filesystem abstractions for agents
- Turn emerging ML research ideas into production-ready infrastructure
- Build platform capabilities for execution, storage, and state management
- Prototype and evaluate new technologies and help determine what moves into production
- Partner with research teams to shape infrastructure for future agent systems
Requirements
- Experience building production ML infrastructure with strong systems fundamentals
- Hands-on experience with agentic systems, multi-agent workflows, or agent development frameworks
- Familiarity with model routing and LLM provider frameworks across different model types and environments
- Experience with scalable, fault-tolerant distributed systems and Kubernetes
- Track record of rapidly prototyping and making sound productionization decisions
- Experience across on-premises, private-cloud, and public-cloud environments is a bonus
- Familiarity with storage systems, embedded databases, or filesystem abstractions is a bonus
- Experience with code-execution sandboxes such as gVisor, Firecracker, Kata, or WebAssembly runtimes is a bonus
- Interest in emerging ML infrastructure, edge inference, or browser-native models is a bonus
- Open-source contributions to LLM or agent infrastructure projects are a bonus
- Experience with identity, workload authentication, or capability-based security systems is a bonus
Benefits
- Weekly lunch stipend, in-office lunches, and snacks
- Full health and dental benefits, including a separate mental-health budget
- 100% parental-leave top-up for up to 6 months
- Personal enrichment benefits for arts and culture, fitness and well-being, quality time, and workspace improvement
- Remote-flexible work arrangement with offices in Toronto, New York, San Francisco, London, and Paris
- Co-working stipend
- Six weeks of vacation, or 30 working days
Tech Stack
Categories
About Cohere
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation models and end-to-end AI products designed to solve real-world business problems. We partner closely with companies to deliver seamless integration, full customization, and easy-to-use solutions for their workforce and customers. Our all-in-one platform offers enterprises the highest levels of data security, privacy and optionality to deploy across all major cloud providers, private cloud environments, or on-premises. HQ: 171 John Street, 2nd Floor, Toronto, ON M5T 1X3