15 hours ago
Base Salary
$174k - $252k/yr
Responsibilities
- Lead technical design, development, and optimization of LLM inference-serving software components on Google Distributed Cloud.
- Develop model lifecycle management, efficient data loading, dynamic request routing, and intelligent load balancing capabilities.
- Integrate platform services including billing, logging, observability, security, and quota management.
- Implement disaggregated serving, speculative decoding, quantization, and distributed model sharding across hardware.
- Collaborate with teams developing LLM frameworks, container orchestration, networking infrastructure, and hardware acceleration.
Requirements
- Bachelor’s degree or equivalent practical experience.
- At least 5 years of software development experience using one or more programming languages.
- At least 3 years of experience testing, maintaining, or launching software products.
- At least 1 year of experience with software design and architecture.
- At least 3 years of experience developing large-scale infrastructure, distributed systems, networks, compute technologies, storage, or hardware architecture.
- Experience programming in Go for software development, including AI/ML applications.
- Preferred qualifications include a master’s degree or PhD in computer science or a related technical field, 5 years of experience with data structures and algorithms, 1 year of technical leadership experience, and experience with Kubernetes and cloud-based AI platforms.
Benefits
- US base salary of $174000-$252000, plus a 15% bonus target, equity, and benefits.
- Google benefits are available as described in the posting.
Tech Stack
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.