16 days ago
Base Salary
$207k - $452k/yr
Responsibilities
- Design and build high-performance inference serving systems for large-scale transformer and multimodal models, including 100B+ and MoE architectures.
- Implement and tune speculative decoding, continuous batching, KV cache management, prefill/decode disaggregation, and INT4/INT8/FP8 quantization.
- Customize inference frameworks such as vLLM, TensorRT-LLM, and SGLang for production requirements.
- Write, profile, and optimize CUDA kernels and custom operations.
- Own end-to-end model deployment, including packaging, serving API design, latency SLO monitoring, and incident response.
- Partner with research teams to implement model architecture changes efficiently for inference.
- Drive technical design and establish inference engineering practices across the team.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent practical experience.
- At least 5 years of software engineering experience, including significant experience with production-depth inference systems or ML infrastructure.
- Hands-on production serving experience with vLLM, TensorRT-LLM, SGLang, ONNX Runtime, or an equivalent inference framework.
- GPU programming experience including CUDA kernel development, memory optimization, and profiling with Nsight or equivalent tools.
- Production experience serving LLMs or large vision models, including ownership of latency SLOs, throughput debugging, and shipped performance optimizations.
- Depth in at least two of speculative decoding, continuous batching, KV cache design, quantization pipelines, and prefill/decode disaggregation.
- Strong Python and C++ systems skills, including the ability to read and modify framework internals.
- Preferred qualifications include a Master’s or PhD, experience with MoE models or 100B+ parameter deployments, disaggregated or multi-node inference experience, and compiler-level optimization experience with XLA, Triton, or similar tools.
Benefits
- Structured hybrid work approach combining office and remote work environments.
- Benefits and perks supporting physical, mental, emotional, and financial health, work-life balance, and community involvement.
- Applications are accepted for at least five days, with an anticipated closing date of November 13, 2026.
Categories
About Zoom
Zoom builds a cloud platform for video meetings, team chat, webinars, phone, rooms, and contact center used by businesses, schools, and public-sector organizations. It sells these collaboration and communications services as SaaS subscriptions with add-ons for events, telephony, and enterprise features, and offers developer APIs/SDKs. Founded in 2013 and headquartered in San Jose, California, Zoom Video Communications is a public company traded on Nasdaq.
