1 day ago
Base Salary
$262k - $364k/yr
Responsibilities
- Maintain LLM training and serving benchmarks to identify performance opportunities and guide XLA releases.
- Drive XLA:GPU and Triton performance toward state-of-the-art results.
- Collaborate with DeepMind to onboard LLM models and products on GPU hardware and improve large-scale training and serving efficiency.
- Run architecture-level GPU simulations and roofline analyses to guide internal teams.
- Explore model and data efficiency techniques, analyze performance metrics, identify bottlenecks, and implement fleet-scale solutions.
- Collaborate with tooling and fleet metrics teams to build performance-tracking tools and extract metrics from production workloads.
Requirements
- Bachelor’s degree or equivalent practical experience.
- 8 years of experience in software development.
- 7 years of experience leading technical project strategy, ML design, and end-to-end machine learning optimization.
- Experience with modern GPU architectures, memory hierarchies, and performance bottlenecks.
- Experience with low-level GPU programming using CUDA, Triton, CUTLASS, or similar technologies.
- Experience with modern LLMs and their deployment on AI accelerators.
- Preferred: master’s degree or PhD in Engineering, Computer Science, or a related technical field.
- Preferred: 8 years of experience with data structures and algorithms.
- Preferred: 5 years of experience in a technical leadership role leading project teams and setting technical direction.
- Preferred: 3 years of experience in a complex, matrixed organization involving cross-functional or cross-business projects.
- Experience with machine learning algorithms and tools.
Benefits
- US base salary of $262000-$364000, plus a 25% bonus target, equity, and benefits.
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.