over 1 year ago
Responsibilities
- Design and write high-performance, scalable software for training.
- Improve the training setup from infrastructure and codebase performance perspectives.
- Build tools to accelerate training cycles and improve the efficacy of training infrastructure.
- Research, implement, and experiment with ideas on supercomputing and data infrastructure.
- Bridge research and production by supporting model training and shipping state-of-the-art models to production.
- Work with researchers and contribute to both production engineering and research efforts.
Requirements
- Extremely strong software engineering skills.
- Proficiency in Python and related ML frameworks such as JAX, PyTorch, and XLA/MLIR.
- Experience with distributed training infrastructure including Kubernetes and Slurm, and associated frameworks such as Ray.
- Experience using large-scale distributed training strategies.
- Hands-on experience training large models at scale and contributing to training infrastructure tooling or setup.
- A paper at a top-tier venue such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, or EMNLP is a bonus.
Benefits
- Open and inclusive culture and work environment.
- Opportunity to work closely with a team conducting cutting-edge AI research.
- Weekly lunch stipend, in-office lunches, and snacks.
- Full health and dental benefits, including a separate mental health budget.
- 100% parental leave top-up for up to six months.
- Personal enrichment benefits for arts and culture, fitness and well-being, quality time, and workspace improvement.
- Remote-flexible work with offices in Toronto, New York, San Francisco, London, and Paris, plus a co-working stipend.
- Six weeks of vacation, or 30 working days.
Tech Stack
Categories
About Cohere
Cohere builds large language models and an enterprise AI platform that companies use for search, summarization, and workflow automation, delivered via API or private deployments. Founded in 2019 and headquartered in Toronto, it focuses on multilingual models, data controls, and options to run across major clouds or on-premises. The business is privately held and serves security- and compliance-sensitive organizations.