Zoom

Staff AI Engineer

Zoom
Apply
16 days ago

Base Salary

$207k - $452k/yr

Responsibilities

  • Design and build high-performance inference serving systems for large-scale transformer and multimodal models, including 100B+ and MoE architectures.
  • Implement and tune speculative decoding, continuous batching, KV cache management, prefill/decode disaggregation, and INT4/INT8/FP8 quantization.
  • Customize inference frameworks such as vLLM, TensorRT-LLM, and SGLang for production requirements.
  • Write, profile, and optimize CUDA kernels and custom operations.
  • Own end-to-end model deployment, including packaging, serving API design, latency SLO monitoring, and incident response.
  • Partner with research teams to implement model architecture changes efficiently for inference.
  • Drive technical design and establish inference engineering practices across the team.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent practical experience.
  • At least 5 years of software engineering experience, including significant experience with production-depth inference systems or ML infrastructure.
  • Hands-on production serving experience with vLLM, TensorRT-LLM, SGLang, ONNX Runtime, or an equivalent inference framework.
  • GPU programming experience including CUDA kernel development, memory optimization, and profiling with Nsight or equivalent tools.
  • Production experience serving LLMs or large vision models, including ownership of latency SLOs, throughput debugging, and shipped performance optimizations.
  • Depth in at least two of speculative decoding, continuous batching, KV cache design, quantization pipelines, and prefill/decode disaggregation.
  • Strong Python and C++ systems skills, including the ability to read and modify framework internals.
  • Preferred qualifications include a Master’s or PhD, experience with MoE models or 100B+ parameter deployments, disaggregated or multi-node inference experience, and compiler-level optimization experience with XLA, Triton, or similar tools.

Benefits

  • Structured hybrid work approach combining office and remote work environments.
  • Benefits and perks supporting physical, mental, emotional, and financial health, work-life balance, and community involvement.
  • Applications are accepted for at least five days, with an anticipated closing date of November 13, 2026.

Tech Stack

Zoom

About Zoom

10,000+ employees

Zoom builds a cloud platform for video meetings, team chat, webinars, phone, rooms, and contact center used by businesses, schools, and public-sector organizations. It sells these collaboration and communications services as SaaS subscriptions with add-ons for events, telephony, and enterprise features, and offers developer APIs/SDKs. Founded in 2013 and headquartered in San Jose, California, Zoom Video Communications is a public company traded on Nasdaq.

Contact me