18 hours ago
Singapore, SingaporeMid Level
H1B Sponsor
Responsibilities
- Lead onboarding and optimization for ML training and serving solutions on new TPU platforms.
- Design, develop, and implement scalable server software for cloud infrastructure from conception through launch.
- Triage, debug, track, and resolve product or system issues affecting hardware, network, service operations, and quality.
- Lead or participate in technical design reviews with peers and stakeholders.
- Support customer onboarding and optimization for large-scale ML training and inference workloads.
Requirements
- Bachelor’s degree or equivalent practical experience.
- At least 2 years of software development experience in one or more programming languages, or 1 year with an advanced degree.
- At least 1 year leading ML design and optimizing ML infrastructure, including deployment, evaluation, data processing, debugging, or fine-tuning.
- At least 1 year of experience with ML training and inference techniques such as Megatron-LM, DeepSpeed, TensorRT-LLM, vLLM, or SGLang.
- Preferred: Master’s degree or PhD in Computer Science or a related technical field.
- Preferred: experience optimizing ML models and improving latency and throughput for large-scale training and inference workloads.
- Preferred: experience with TPUs, GPUs, or HPC.
- Experience with firmware design, kernel development, and server system integration is expected for the responsibilities.
Tech Stack
Google Cloud
Categories
About Google
A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone. Check out our career opportunities at goo.gle/3DLEokh