9 months ago
Responsibilities
- Build reliable machine learning systems and optimize audio inference serving efficiency.
- Advance latency, throughput, and quality metrics for core audio model serving.
- Identify system bottlenecks and deliver solutions for audio processing and streaming workloads.
- Collaborate with training and serving infrastructure teams to integrate model development and deployment.
- Focus on real-time and streaming audio inference.
Requirements
- Significant experience developing high-performance audio or machine learning inference systems.
- Proficiency with programming languages such as C++ and Python.
- Hands-on experience with deep learning models for audio, speech, or language applications.
- Experience with GPU programming, low-level system optimization, and model parallelization across multiple GPUs is a plus.
- Experience with duplex real-time streaming architectures is a plus.
- Experience with PyTorch, TensorFlow, or specialized audio libraries is a plus.
- Experience with inference frameworks such as vLLM, SGLang, TensorRT-LLM, or custom distributed inference systems is a plus.
- Experience with sequence modeling and end-to-end audio pipeline optimization is a plus.
Benefits
- Remote-flexible work environment with offices in Toronto, Montreal, San Francisco, New York, Paris, Seoul, and London, plus a co-working stipend
- Weekly lunch stipend, in-office lunches, and snacks
- Full health and dental benefits, including a separate mental health budget
- Parental leave top-up for up to 6 months
- Personal enrichment benefits for arts and culture, fitness and well-being, quality time, and workspace improvement
- Six weeks of vacation, or 30 working days
Categories
About Cohere
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation models and end-to-end AI products designed to solve real-world business problems. We partner closely with companies to deliver seamless integration, full customization, and easy-to-use solutions for their workforce and customers. Our all-in-one platform offers enterprises the highest levels of data security, privacy and optionality to deploy across all major cloud providers, private cloud environments, or on-premises. HQ: 171 John Street, 2nd Floor, Toronto, ON M5T 1X3