1 day ago
Base Salary
$270k - $335k/yr
Responsibilities
- Deploy and operate GPU Kubernetes clusters across multiple clouds.
- Bring new hardware generations and cloud providers into production.
- Partner with cloud providers and hardware vendors on reliability, performance, cost, RDMA, and high-speed interconnects.
- Automate node, GPU, and fabric fault detection and remediation.
- Improve fleet utilization, reduce infrastructure costs, and shorten faulty-node recovery times.
- Troubleshoot production failures and performance problems.
- Participate in a compensated 24x7 on-call rotation.
Requirements
- Experience running GPU Kubernetes clusters with thousands of GPUs for ML or HPC workloads.
- Experience debugging Linux, networking, and performance problems.
- Experience writing software in Python or Go.
- Familiarity with RDMA, NCCL, or accelerator health is preferred.
- Experience collaborating with researchers, ML engineers, or teams with differing goals.
- Demonstrated ability to identify bottlenecks, propose fixes, and drive implementation in a fast-moving environment.
Benefits
- Remote-friendly work arrangement with offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.
- Weekly lunch stipend of $75/£75 or equivalent in local currency.
- Full health and dental benefits, including a separate mental-health budget.
- RRSP matching, 401K, and pension scheme.
- 100% parental-leave top-up for up to six months for either parent.
- Annual enrichment benefits for arts and culture, fitness and wellness, quality time, and workspace improvements.
- Education and learning stipend for conferences, courses, and coaching.
- Six weeks of paid vacation, or 30 working days.
- Travel budget for remote employees to visit other offices and an annual company offsite.
- Daily lunch program, snacks, and community events for office employees.
- Coworking benefit for employees not near an office.
- $500 home-office stipend.
Tech Stack
Categories
About Cohere
Cohere builds large language models and an enterprise AI platform that companies use for search, summarization, and workflow automation, delivered via API or private deployments. Founded in 2019 and headquartered in Toronto, it focuses on multilingual models, data controls, and options to run across major clouds or on-premises. The business is privately held and serves security- and compliance-sensitive organizations.