12 hours ago
Base Salary
$307k - $427k/yr
Responsibilities
- Lead the architectural direction for llm-d and distributed LLM and reinforcement learning serving across the GKE fleet.
- Define GKE’s evolution for massive-scale inference and reinforcement learning, including dynamic resource allocation, multi-host TPU/GPU scheduling, and high-throughput networking.
- Partner with strategic AI model builders, DeepMind, and Vertex AI to co-develop an AI-first roadmap using Google’s custom silicon.
- Lead Kubernetes and open-source ecosystem initiatives establishing standards for AI, reinforcement learning, and accelerator orchestration.
- Represent the organization’s technical vision to senior customer stakeholders and influence product, engineering, and research teams.
Requirements
- Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.
- 15 years of experience in software engineering, or 15 years of experience with an advanced degree.
- Experience building distributed systems and driving technical strategy for platform-level infrastructure.
- Experience with Kubernetes, container runtimes, and AI/ML infrastructure such as inference serving, LLMs, and hardware accelerators.
- Preferred: master’s degree or PhD in Computer Science or a related technical field.
- Preferred: significant technical contributions to Kubernetes or related CNCF AI/ML projects such as Kueue.
- Preferred: deep understanding of RDMA, NCCL, storage and caching architectures for massive model weights, and accelerator virtualization and sharing mechanisms.
Benefits
- 30% bonus target, equity, and benefits are included in the compensation package.
- The role is based in the US; no remote, hybrid, or office schedule is stated.
Tech Stack
Google CloudKubernetes
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.