1 day ago
Base Salary
$147k - $210k/yr
Responsibilities
- Analyze ML workloads and identify compute and memory bandwidth bottlenecks to optimize accelerator utilization.
- Implement and productionize model-efficiency techniques including low-precision quantization, knowledge distillation, parameter sharing, and attention optimizations.
- Optimize serving and distributed data pipelines, including data ingestion, feature transformation, embedding lookups, and memory caching.
- Collaborate with ML model developers and researchers to co-design hardware-friendly architectures and deploy efficiency libraries.
- Design, develop, test, deploy, maintain, and enhance software solutions while managing project priorities, deadlines, and deliverables.
Requirements
- Bachelor’s degree or equivalent practical experience.
- At least 2 years of experience with ML infrastructure, such as model deployment, model evaluation, data processing, or debugging.
- At least 2 years of experience with TPU or GPU accelerator hardware architectures.
- At least 2 years of programming experience in C++ and Python.
- Experience with TensorFlow, JAX, PyTorch, or ML compilers such as XLA.
- Experience with ML model optimization.
- Preferred: master’s degree or PhD in computer science or a related technical field.
- Preferred: experience developing accessible technologies, debugging correctness and performance issues across the ML software stack, and working with ML compiler internals and compiler optimization passes.
Benefits
- US base salary of $147000 - $210000, plus a 15% bonus target, equity, and benefits.
- Google benefits are available; the posting directs candidates to learn more about them.
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.