Google

Staff Software Engineer, ML Systems Co-Design

Google
Apply
7 hours ago
Mountain View, CA, USAStaff+
H1B sponsor

Base Salary

$207k - $300k/yr

Responsibilities

  • Deliver certified performance ladders six months before pilot for pricing, capacity planning, and XLA/kernel optimization.
  • Adapt emerging open-source models into TPU-native paired variants, including sparsity-optimized variants.
  • Ingest and optimize multi-turn agentic workflows, reasoning loops, and prompt/decode-disaggregated topologies ahead of silicon.
  • Author reference implementations in PyTorch, JAX, and Pallas that meet pre-pilot goals under real-world compiler constraints.
  • Partner with technical leadership across TPU Hardware, XLA Compiler, and Cloud AI Systems to steer multi-year roadmaps.
  • Design, develop, test, deploy, maintain, and enhance software solutions while managing project priorities, deadlines, and deliverables.

Requirements

  • Bachelor's degree or equivalent practical experience.
  • At least 8 years of experience programming in C++ or Python.
  • At least 5 years of experience testing and launching software products.
  • At least 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging.
  • At least 3 years of experience with software design and architecture.
  • Preferred: deep proficiency in ML workload performance modeling on pre-silicon systems, compiler intermediate representations such as MLIR dialects, XLA, and HLO, ML execution frameworks such as JAX, PyTorch, and PyTorch/XLA, or accelerator kernel programming with Pallas, Triton, or CUDA.
  • Preferred: experience architecting, validating, or extending high-performance simulation tools, emulation frameworks, or analytical performance modeling pipelines such as roofline models and cycle-accurate or compiler-aware simulators.
  • Preferred: L6-level ability to lead complex, multi-quarter technical initiatives across hardware design, compilers, AI research, and cloud infrastructure.

Benefits

  • US base salary of $207000-$300000, plus a 20% bonus target, equity, and benefits.
  • Benefits information is available through Google.
  • Role supports cross-organizational work across TPU Hardware, XLA Compiler, and Cloud AI Systems.

Tech Stack

C++Google CloudPythonPyTorch

Categories

Google

About Google

10,000+ employees

Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.

Contact me