11 months ago
Responsibilities
- Build reliable machine learning systems and optimize audio inference serving efficiency.
- Advance latency, throughput, and quality metrics for core audio model serving.
- Identify system bottlenecks and deliver solutions for audio processing and streaming workloads.
- Collaborate with training and serving infrastructure teams to integrate model development and deployment.
- Focus on real-time and streaming audio inference.
Requirements
- Significant experience developing high-performance audio or machine learning inference systems.
- Proficiency with programming languages such as C++ and Python.
- Hands-on experience with deep learning models for audio, speech, or language applications.
- Experience with GPU programming, low-level system optimization, and model parallelization across multiple GPUs is a plus.
- Experience with duplex real-time streaming architectures is a plus.
- Experience with PyTorch, TensorFlow, or specialized audio libraries is a plus.
- Experience with inference frameworks such as vLLM, SGLang, TensorRT-LLM, or custom distributed inference systems is a plus.
- Experience with sequence modeling and end-to-end audio pipeline optimization is a plus.
Benefits
- Remote-flexible work environment with offices in Toronto, Montreal, San Francisco, New York, Paris, Seoul, and London, plus a co-working stipend
- Weekly lunch stipend, in-office lunches, and snacks
- Full health and dental benefits, including a separate mental health budget
- Parental leave top-up for up to 6 months
- Personal enrichment benefits for arts and culture, fitness and well-being, quality time, and workspace improvement
- Six weeks of vacation, or 30 working days
Categories
About Cohere
Cohere builds large language models and an enterprise AI platform that companies use for search, summarization, and workflow automation, delivered via API or private deployments. Founded in 2019 and headquartered in Toronto, it focuses on multilingual models, data controls, and options to run across major clouds or on-premises. The business is privately held and serves security- and compliance-sensitive organizations.