2 hours ago
Toronto, CanadaSenior
Base Salary
$160k - $260k/yr
Responsibilities
- Build secure execution environments for agent-generated code.
- Develop identity, authentication, trust-boundary, model-routing, orchestration, quota, rate-limiting, and resource-management capabilities for agent workflows.
- Build platform capabilities for execution, storage, state management, memory, and filesystem abstractions.
- Translate emerging ML research into production-ready infrastructure.
- Prototype and evaluate technologies and determine which capabilities should move into production.
- Partner with research teams to shape infrastructure for future agent systems.
Requirements
- Experience building production ML infrastructure with strong systems fundamentals.
- Hands-on experience with agentic systems, multi-agent workflows, or agent development frameworks.
- Familiarity with model routing and LLM provider frameworks across model types and environments.
- Experience with scalable, fault-tolerant distributed systems and Kubernetes.
- A track record of rapidly prototyping and making sound productionization decisions.
- Preferred experience includes on-premises, private-cloud, and public-cloud environments; storage systems, embedded databases, or filesystem abstractions; code-execution sandboxes; emerging ML infrastructure, edge inference, or browser-native models; open-source LLM or agent infrastructure; and identity, workload authentication, or capability-based security systems.
Benefits
- Weekly lunch stipend of $75/£75 or equivalent in local currency.
- Full health and dental benefits with a separate mental-health budget.
- RRSP matching, 401K, and pension scheme.
- Up to six months of 100% parental-leave top-up for either parent.
- Annual arts and culture, fitness and wellness, quality-time, and workspace-improvement benefits.
- Education and learning stipend for conferences, courses, and coaching.
- Six weeks of paid vacation.
- Remote-friendly work arrangement with offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.
- Remote employees receive coworking benefits, travel budget for visiting other offices, an annual company offsite, and a $500 home-office stipend.
Tech Stack
Categories
About Cohere
Cohere builds large language models and an enterprise AI platform that companies use for search, summarization, and workflow automation, delivered via API or private deployments. Founded in 2019 and headquartered in Toronto, it focuses on multilingual models, data controls, and options to run across major clouds or on-premises. The business is privately held and serves security- and compliance-sensitive organizations.