Google

Senior Staff Software Engineer, AI/ML, Google Cloud Compute Infrastructure

Google
Apply
22 hours ago
Sunnyvale, CA, USAStaff+
H1B sponsor

Base Salary

$262k - $364k/yr

Responsibilities

  • Lead technical goals, roadmaps, and software architecture for hardware/software co-design optimizing large-scale ML inference and training systems.
  • Design and oversee simulation frameworks, cycle-accurate performance models, and system analysis tools for architectural trade-off evaluation.
  • Architect scalable software solutions, kernels, and execution pipelines connecting frontier ML models with custom silicon accelerators.
  • Optimize distributed ML infrastructure across compute, memory bandwidth, and inter-chip networking.
  • Provide technical leadership and mentorship across hardware, compiler, and ML research teams.

Requirements

  • Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, a related technical field, or equivalent practical experience.
  • Eight years of experience in software development, systems engineering, or hardware/software co-design.
  • Five years of experience with machine learning systems, architecture, performance modeling, or simulation frameworks.
  • Experience with JAX, PyTorch, TensorFlow, and large language model inference or training workloads.
  • Preferred qualifications include a master’s degree or PhD in a related technical field.
  • Preferred qualifications include five years in a technical leadership role leading project teams and setting technical direction.
  • Experience with multi-generational hardware/software co-design, large-scale ML performance optimization, accelerator programming, ML compilers, deep learning execution models, and system-level performance analysis.

Tech Stack

Google CloudPyTorchTensorFlow
Google

About Google

10,000+ employees

Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.

Contact me