3 days ago
Base Salary
$890k - $1690k/yr
Responsibilities
- Lead the technical architecture and direction of Netflix’s AI/ML model-serving platform.
- Build serving, routing, experimentation, and execution infrastructure for real-time, asynchronous, near-real-time, and agentic workloads.
- Improve inference cost, latency, GPU utilization, and capacity through disaggregated serving, intelligent routing, speculative decoding, prompt caching, and multi-GPU inference.
- Design scalable foundation-model serving systems and durable, resumable execution for long-running agentic workloads.
- Guide architectural decisions and alignment across multiple teams through technical influence and expertise.
- Shape two- to three-year technical roadmaps and ensure scalability, maintainability, reliability, security, and business alignment.
- Partner with product managers, operations, and executive stakeholders on technical trade-offs.
- Produce architecture decision records, proposals, documentation, and clear communication for technical and non-technical audiences.
Requirements
- Bachelor’s, master’s, or doctoral degree in Computer Science, Applied Math, Engineering, or a related field.
- 12+ years of relevant experience in AI/ML infrastructure and distributed systems.
- Experience with high-traffic distributed services and infrastructure for AI/ML model inference, including high availability, security, and performance.
- Experience building scalable foundation-model serving solutions and reducing inference latency and costs.
- Familiarity with NVIDIA Triton Inference Server, vLLM, or SGLang, and scaling model-serving systems with Kubernetes.
- Experience with public cloud infrastructure such as AWS, Azure, or GCP.
- Preferred: open-source contributions in AI/ML, distributed systems, or infrastructure.
- Preferred: hands-on AI model development and optimization techniques such as quantization, model compression, or model pruning.
- Preferred: experience with model gateways, intelligent routing, multi-adapter serving, disaggregated prefill/decode, or large-scale KV-cache management.
- Preferred: experience with LLM and AI-agent evaluation and benchmarking tools.
- Preferred: knowledge of GPU topology, NVIDIA CUDA programming, and machine-learning compilers.
- Preferred: proficiency using AI coding tools in software development.
Benefits
- Annual salary plus a stock-options choice, with a stated compensation range of $890,000.00–$1,690,000.00 depending on location.
- Health plans, mental-health support, a 401(k) retirement plan with employer match, stock option program, disability programs, health savings and flexible spending accounts, family-forming benefits, and life and serious-injury benefits.
- Paid leave programs; full-time salaried employees are immediately entitled to flexible time off.
- Netflix provides accommodation support during the hiring process and is an equal-opportunity employer.
Tech Stack
Categories
About Netflix
Netflix builds and operates a global streaming service for TV series, films, games, and live programming, and produces original content through its in-house studio. It serves consumers in 190+ countries via subscription and ad-supported plans on internet-connected devices. Founded in 1997 and headquartered in Los Gatos, California, Netflix is a public company traded on NASDAQ (NFLX).