over 1 year ago
Responsibilities
- Design and write high-performance, scalable software for training.
- Improve the training setup from infrastructure and codebase performance perspectives.
- Build tools to accelerate training cycles and improve the efficacy of training infrastructure.
- Research, implement, and experiment with ideas on supercomputing and data infrastructure.
- Bridge research and production by supporting model training and shipping state-of-the-art models to production.
- Work with researchers and contribute to both production engineering and research efforts.
Requirements
- Extremely strong software engineering skills.
- Proficiency in Python and related ML frameworks such as JAX, PyTorch, and XLA/MLIR.
- Experience with distributed training infrastructure including Kubernetes and Slurm, and associated frameworks such as Ray.
- Experience using large-scale distributed training strategies.
- Hands-on experience training large models at scale and contributing to training infrastructure tooling or setup.
- A paper at a top-tier venue such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, or EMNLP is a bonus.
Benefits
- Open and inclusive culture and work environment.
- Opportunity to work closely with a team conducting cutting-edge AI research.
- Weekly lunch stipend, in-office lunches, and snacks.
- Full health and dental benefits, including a separate mental health budget.
- 100% parental leave top-up for up to six months.
- Personal enrichment benefits for arts and culture, fitness and well-being, quality time, and workspace improvement.
- Remote-flexible work with offices in Toronto, New York, San Francisco, London, and Paris, plus a co-working stipend.
- Six weeks of vacation, or 30 working days.
Tech Stack
Categories
About Cohere
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation models and end-to-end AI products designed to solve real-world business problems. We partner closely with companies to deliver seamless integration, full customization, and easy-to-use solutions for their workforce and customers. Our all-in-one platform offers enterprises the highest levels of data security, privacy and optionality to deploy across all major cloud providers, private cloud environments, or on-premises. HQ: 171 John Street, 2nd Floor, Toronto, ON M5T 1X3