Google

Software Engineer, On-Device Machine Learning

Google
Apply
1 day ago
Sunnyvale, CA, USAMid Level
H1B Sponsor

Base Salary

$147k - $210k/yr

Responsibilities

  • Collaborate with peers and stakeholders through design and code reviews to maintain code quality, accuracy, testability, and efficiency.
  • Implement solutions in specialized ML areas using ML infrastructure, model optimization, and data processing.
  • Develop LiteRT for on-device AI use cases across mobile, web, desktop, and embedded platforms.
  • Enable deployment of models such as Gemini Nano and Gemma across GPU, Pixel TPU, NPU, and CPU accelerators.
  • Improve on-device inference performance through runtime and kernel implementation optimizations.

Requirements

  • Bachelor’s degree or equivalent practical experience.
  • Two years of software development experience in one or more programming languages, or one year with an advanced degree.
  • Two years of experience with ML infrastructure, including model deployment, evaluation, optimization, data processing, or debugging.
  • Experience with runtimes, performance tuning, and mobile development.
  • Preferred experience leading on-device ML projects and using PyTorch, JAX, TensorFlow, TensorFlow Lite, ExecuTorch, Core ML, SNPE, or QNN.
  • Preferred understanding of generative AI model architectures and their optimization for on-device execution.
  • Preferred master’s degree or PhD in Computer Science or a related technical field.

Tech Stack

Google CloudiOSPyTorchTensorFlow
Google

About Google

10,000+ employees

A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone. Check out our career opportunities at goo.gle/3DLEokh

Contact me