1 day ago
Base Salary
$207k - $300k/yr
Responsibilities
- Lead technical architecture and system design for 1–6-month Forward Deployed Engineer embeds and 2–4-week Strike Sprints targeting machine learning efficiency bottlenecks.
- Design, prototype, and write production C++ and Python for model compression, speculative decoding, dynamic batching, and high-throughput serving pipelines.
- Diagnose distributed latency and throughput bottlenecks across XManager, Pathways, and TPU/GPU clusters, implementing low-level kernel and memory optimizations.
- Translate ambiguous executive mandates into rigorously scoped efficiency projects with latency, FLOPs, and tokenomics targets.
- Design automated distillation, pruning, and quantization pipelines that produce efficient student models while preserving evaluation performance.
Requirements
- Bachelor’s degree or equivalent practical experience.
- 8 years of experience in software development.
- 5 years of experience testing and launching software products and 3 years of experience with software design and architecture.
- 5 years of experience in speech/audio, reinforcement learning, ML infrastructure, or another ML field.
- 5 years of experience with ML design and ML infrastructure, including model deployment, evaluation, data processing, debugging, or fine-tuning.
- Experience integrating generative AI tools or LLM interfaces into workflows.
- Preferred: Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
- Preferred: 8 years of experience with data structures and algorithms and 3 years in a technical leadership role leading project teams and setting technical direction.
- Preferred: experience with low-level accelerator programming and compilation toolchains such as XLA, Pallas, CUDA, Triton, or custom TPU kernels.
- Preferred: experience leading rapid prototyping pods and influencing VP/Director-level technical roadmaps.
- Preferred: demonstrated success optimizing large-scale production ML serving or training systems for measurable compute or cost savings.
Benefits
- US base salary of $207000–$300000, plus a 20% bonus target, equity, and benefits.
- Google benefits are available as described in the posting.
Categories
Forward DeployedML Engineering
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.