Google

Staff Software Engineer, TPU, Performance

Google
Apply
23 hours ago
Sunnyvale, CA, USAStaff+
H1B sponsor

Base Salary

$207k - $300k/yr

Responsibilities

  • Maintain ML training and serving benchmarks representative of Google production workloads and the broader ML industry.
  • Achieve performance targets for customer launches and third-party or open-source model benchmark submissions.
  • Use benchmarks to identify performance opportunities and drive compiler and runtime improvements.
  • Work with Google product teams and researchers to solve performance problems, onboard ML models to new TPU hardware, and enable efficient large-scale training.
  • Analyze performance and efficiency metrics, identify bottlenecks, and design and implement solutions at Google fleet-wide scale.

Requirements

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience in speech/audio, reinforcement learning, ML infrastructure, or another ML field.
  • 5 years of experience with ML design and ML infrastructure, including model deployment, model evaluation, data processing, debugging, or fine-tuning.
  • 5 years of experience testing and launching software products and 3 years of experience with software design and architecture.
  • Preferred: master’s degree or PhD in engineering, computer science, or a related technical field.
  • Preferred: 8 years of experience with data structures and algorithms.
  • Preferred: experience with machine learning, compiler optimization, code generation, and runtime systems for GPU architectures, including OpenXLA, MLIR, or Triton.
  • Preferred: experience tailoring algorithms and ML models to ML accelerator architectures, low-level GPU programming, and performance tuning.
  • Preferred: understanding of GPU, TPU, and other ML accelerator architectures, memory hierarchies, and performance bottlenecks.

Benefits

  • US base salary of $207000 - $300000, plus a 20% bonus target, equity, and benefits.
  • Benefits information is available through Google’s benefits program.

Tech Stack

Categories

Google

About Google

10,000+ employees

Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.

Contact me