22 hours ago
Base Salary
$147k - $210k/yr
Responsibilities
- Write product or system development code and manually optimize models using sharding, quantization, and custom kernels.
- Develop cost models for compute, communication, scheduling, and quantization, including agentic AI approaches.
- Collaborate with compiler teams and build agentic tooling for performance headroom analysis.
- Create scalable software performance solutions and open-source tooling for third-party customers.
- Develop trend analysis and maintain model benchmarks to identify performance issues and track improvements.
Requirements
- Bachelor’s degree or equivalent practical experience.
- At least 2 years of software development experience in one or more programming languages.
- At least 2 years of experience with computer architecture, performance analysis, and performance modeling.
- Experience experimenting with AI agents or LLM-powered agentic workflows.
- Experience in systems engineering.
- Preferred: Master’s degree or PhD in Computer Science or a related technical field.
- Preferred: experience with low-level accelerator programming, including CUDA, Triton, or Pallas, and performance tuning.
- Preferred: experience with machine learning, compiler optimization, code generation, and runtime systems for GPU architectures, including OpenXLA, MLIR, or Triton.
- Preferred: debugging experience improving single-mode or distributed multi-mode systems.
- Preferred: expertise tailoring algorithms and ML models to ML accelerator architectures and understanding modern accelerator architectures, memory hierarchies, and performance bottlenecks.
Benefits
- Google benefits are provided; the posting also lists equity and a 15% bonus target as part of the compensation package.
Tech Stack
Google Cloud
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.