13 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Optimize Gemini model serving for speed and cost through speculative decoding, prefix caching, sharding, quantization, load tests, and live experiments.
- Analyze new Gemini revisions and design serving topologies that maximize quality and efficiency on TPU infrastructure.
- Build production guardrails, pre-submit checks, monitoring, and fast rollback mechanisms for Search AI systems.
- Qualify new model checkpoints, develop evaluation and autorater strategies, and diagnose performance regressions.
- Write technical design documentation and contribute to design and code reviews.
Requirements
- Bachelor’s degree or equivalent practical experience.
- At least 5 years of software development experience in one or more programming languages.
- At least 3 years of full-stack development experience across back-end codebases such as Java, Python, Golang, or C++ and front-end technologies including JavaScript, TypeScript, HTML, or CSS.
- Experience designing, building, and operating large-scale distributed systems with emphasis on scalability, fault tolerance, and reliability.
- Experience with AI, generative AI, data processing, performance, or scalability optimization.
- Experience with data structures or machine learning algorithms.
- Preferred: Master’s degree or PhD in Computer Science or a related technical field.
- Preferred: at least 3 years of experience with machine learning model serving, LLM inference, or machine learning evaluation systems.
- Preferred: experience optimizing TPU or GPU workloads through profiling, sharding, batching, caching, or quantization.
- Preferred: experience leading technical projects across teams from design through launch and with safe production rollout practices.
- Preferred: ability to communicate with researchers, product teams, and leadership to make decisions.
Tech Stack
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.
