3 months ago
Remote, United StatesStaff+
Responsibilities
- Design and operate distributed training systems for large neural networks across GPU clusters.
- Optimize multi-node and multi-GPU execution, GPU utilization, throughput, memory usage, and networking performance.
- Build and optimize GPU cluster orchestration with Slurm, Kubernetes, Ray, and RunAI.
- Debug distributed communication using NCCL, RDMA, InfiniBand, and NVLink.
- Scale training with PyTorch Distributed, Megatron-LM, and DeepSpeed, including launch configurations, failure recovery, and performance tuning.
- Apply activation checkpointing, ZeRO Stages 1–3, and offload strategies to increase model and batch scale.
- Improve training stability and fault tolerance and partner with research and applied ML teams to productionize large-model training pipelines.
Requirements
- Deep hands-on experience with distributed systems or ML systems.
- Production experience running large-scale workloads on GPU clusters.
- Production experience with PyTorch distributed training.
- Strong understanding of data, tensor, and pipeline parallelism strategies.
- Low-level understanding of GPU communication and networking.
- Experience with GPU orchestration tools including Slurm, Kubernetes, Ray, and RunAI.
- Experience with NCCL, RDMA, InfiniBand, NVLink, PyTorch Distributed, Megatron-LM, DeepSpeed, activation checkpointing, and ZeRO offload techniques.
- Experience as an ML Systems Engineer, Distributed Systems Engineer, AI Infrastructure Engineer, or HPC Engineer transitioning into ML is relevant.
- Experience with large language models or foundation models is a strong plus.
Tech Stack
Categories
About Cerence
Cerence builds automotive voice and conversational AI—speech recognition, natural language understanding, text-to-speech, and generative assistants—embedded in vehicles for automakers and transportation OEMs. Spun out of Nuance in 2019 and headquartered in Burlington, Massachusetts, the public company (NASDAQ: CRNC) licenses software and services for in-car infotainment and HMI. Its technology ships in over 500 million vehicles, with customers including brands such as BMW, Audi, Ford, and Daimler.