3 days ago
Singapore, SingaporeSenior
Responsibilities
- Lead customer onboarding and optimization for ML training and serving solutions on the latest TPU platforms.
- Work with customers to move ML workloads into production and optimize their performance.
- Architect training and inference onboarding and optimization frameworks.
- Collaborate with ML research, ML performance, model optimization tooling, and other optimization teams.
- Ship stable TPU-based training and inference optimization solutions to customers.
- Prepare and optimize very large reference models and demonstrate large-scale single-host and multi-host inference solutions.
Requirements
- Bachelor’s degree or equivalent practical experience.
- Five years of software development experience in one or more programming languages.
- Two years of experience leading ML design and optimizing ML infrastructure, including model deployment, model evaluation, data processing, debugging, or fine-tuning.
- One year of experience with training and inference techniques, including tools such as Megatron-LM, DeepSpeed, TensorRT-LLM, vLLM, or SGLang.
- Preferred: master’s degree or PhD in computer science or a related technical field.
- Preferred: experience optimizing ML models for large-scale training and inference workloads and improving latency and throughput.
- Preferred: experience with TPUs, GPUs, or HPC.
Tech Stack
Google Cloud
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.