29 days ago
Toronto, CanadaSenior
Responsibilities
- Build, deploy, and operate Kubernetes-based GPU/TPU superclusters across multiple clouds.
- Optimize infrastructure for AI/ML training performance, reliability, and cost using RDMA, NCCL, and high-speed interconnects.
- Diagnose and resolve infrastructure bottlenecks, performance degradation, and system failures.
- Create self-service interfaces and workflows for researchers to monitor, debug, and optimize training jobs.
- Translate emerging needs involving JAX, PyTorch, and distributed training into scalable infrastructure solutions.
- Promote observability, automation, infrastructure-as-code, maintainability, and resilience.
- Collaborate with AI researchers, ML engineers, cloud providers, and other engineering teams.
- Contribute to code reviews, documentation, mentorship, and knowledge transfer.
- Participate in a compensated 24x7 on-call rotation.
Requirements
- Deep experience with ML/HPC infrastructure, GPU/TPU clusters, distributed training frameworks, and high-performance computing environments.
- Proven ability to deploy, manage, and troubleshoot Kubernetes clusters at scale for AI workloads.
- Proficiency in Python for ML tooling and Go for systems engineering.
- Familiarity with Linux internals, RDMA networking, and performance optimization for ML workloads.
- Experience collaborating with AI researchers or ML engineers on infrastructure challenges.
- Ability to identify bottlenecks, propose solutions, and drive impact in a fast-paced environment.
- Open-source contribution experience is preferred.
Benefits
- Weekly lunch stipend of $75/£75 or local equivalent.
- Full health and dental benefits with a separate mental health budget.
- RRSP matching, 401K, and pension scheme options.
- 100% parental leave top-up for up to six months for either parent.
- Annual arts and culture, fitness and wellness, quality time, workspace improvement, education, and learning benefits.
- Six weeks of paid vacation, equivalent to 30 working days.
- Travel budget for remote employees to visit other offices and an annual company offsite.
- Remote-friendly work arrangement with offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.
- Coworking benefit for employees not near an office and a $500 home office stipend.
- Office employees receive a daily lunch program, snacks, and community and social events.
Tech Stack
Categories
About Cohere
Cohere builds large language models and an enterprise AI platform that companies use for search, summarization, and workflow automation, delivered via API or private deployments. Founded in 2019 and headquartered in Toronto, it focuses on multilingual models, data controls, and options to run across major clouds or on-premises. The business is privately held and serves security- and compliance-sensitive organizations.