20 hours ago
London, United KingdomSenior
Responsibilities
- Maintain LLM training and serving benchmarks representative of Google production, industry, and the ML community.
- Identify performance opportunities and drive Accelerated Linear Algebra, GPU, and Triton performance improvements while guiding XLA releases.
- Partner with product teams such as DeepMind to onboard LLM models and products on GPU hardware and improve large-scale training and serving efficiency.
- Run architecture-level simulations on GPU designs and perform roofline analysis to guide internal teams.
- Analyze performance and efficiency metrics, identify bottlenecks, and implement solutions at Google fleet-wide scale.
- Run performance benchmarks on GPU hardware using internal and external tools.
Requirements
- Bachelor’s degree or equivalent practical experience.
- Five years of experience with software development in one or more programming languages.
- Five years of experience with data structures and algorithms.
- Five years of experience with machine learning algorithms and tools, artificial intelligence, deep learning, or natural language processing.
- Three years of experience testing, maintaining, or launching software products and one year of experience with software design and architecture.
- Preferred: master’s degree or PhD in Computer Science or a related technical field.
- Preferred: one year of experience in a technical leadership role.
- Preferred: experience with hardware/compiler co-design or high-performance computing.
- Preferred: experience analyzing and debugging performance and improving single-node or distributed systems.
- Preferred: experience with GPU programming using CUDA, Triton kernels, or Palace/Mosaic kernels.
- Preferred: background in compiler optimizations or related fields.
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.