Senior Machine Learning Engineer, Voice AI
Together AI4 months ago
Base Salary
$200k - $260k/yr
Responsibilities
- Own and optimize the model serving stack for STT, TTS, and speech-to-speech workloads.
- Optimize TTFB, throughput, and GPU utilization across voice models and accelerators.
- Productionize voice models on serverless and dedicated endpoints using batching, streaming inference, and audio-specific memory management.
- Build and maintain evaluation frameworks measuring STT WER and TTS naturalness, latency, and pronunciation accuracy.
- Enable new architectures, including audio-native LLMs, codec-based models, and speech-to-speech systems.
- Integrate and optimize partner models from Cartesia, Deepgram, Rime, and others on Together AI infrastructure.
- Profile and debug performance from GPU kernels through framework-level bottlenecks and deliver measurable improvements.
- Collaborate with platform engineering to meet real-time voice API latency and reliability requirements.
- Contribute to customer-facing speech-model fine-tuning capabilities and help establish future voice products.
Requirements
- 5+ years of experience in ML engineering focused on model serving, inference optimization, or ML infrastructure.
- Hands-on experience with LLM serving engines such as vLLM, SGLang, or TensorRT-LLM, including reading and modifying engine internals.
- Strong proficiency in Python and PyTorch, with experience in GPU profiling, CUDA, memory management, and kernel-level debugging.
- Demonstrated experience shipping production ML systems with measurable performance improvements.
- Experience with speech and audio ML, including ASR, TTS architectures, or audio signal processing, is preferred but not required.
- Familiarity with SNAC, Encodec, and DAC audio codecs or tokenization schemes is preferred.
- Experience training or fine-tuning speech models is preferred.
- Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
- Ability to work effectively on a small, early-stage team and apply product judgment to developer needs.
Benefits
- Startup equity, health insurance, and other competitive benefits are offered.
- This is a full-time position with a US base salary range of $200,000-$260,000.
Categories
About Together AI
Together AI builds an AI-native cloud platform for developers, offering high-performance inference, fine-tuning/model shaping, and large-scale pre-training on on-demand GPU clusters with APIs and managed services. It emphasizes open-source models that teams can run and adapt, and also provides infrastructure for decentralized and scalable workloads. Founded in 2022 and headquartered in San Francisco, it is privately held and reports notable customers including Cursor, ElevenLabs, Salesforce, and Zoom.