2 months ago
Base Salary
$207k - $300k/yr
Responsibilities
- Identify and maintain LLM training and serving benchmarks to uncover performance opportunities and guide XLA:GPU, Triton, and XLA releases.
- Partner with product teams such as Google DeepMind to onboard, optimize, and scale LLMs and machine learning models on GPU hardware.
- Conduct architecture-level simulations, performance benchmarking, and roofline analyses using TRT-LLM, vLLM, and SGLang.
- Analyze fleet-wide performance and efficiency metrics to identify bottlenecks and implement scalable infrastructure optimizations.
- Research and implement model and data efficiency techniques, tooling, and profiling mechanisms to improve workload and training performance.
Requirements
- Bachelor’s degree or equivalent practical experience.
- 8 years of experience in software development.
- 5 years of experience with ML design and ML infrastructure, including model deployment, model evaluation, data processing, debugging, or fine-tuning.
- Experience with modern GPU architectures, memory hierarchies, performance bottlenecks, low-level GPU programming, and performance engineering.
- Experience with modern LLMs and their deployment on AI accelerators.
- 8 years of experience with data structures and algorithms.
- 3 years of experience in a technical leadership role leading project teams and setting technical direction.
- 3 years of experience working in a complex, matrixed organization involving cross-functional or cross-business projects.
- Experience with hardware-aware algorithm design, compiler stacks such as OpenXLA, large-scale ML models, and distributed systems across accelerator hardware.
- A master’s degree or PhD in Engineering, Computer Science, or a related technical field is preferred.
Benefits
- US base salary of $207000 - $300000, plus a 20% bonus target, equity, and benefits.
- Benefits information is available through Google’s benefits program.
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.