Google

Senior Software Engineer, Machine Learning, TPU Workload Optimization

Google
Apply
2 months ago
Singapore, SingaporeSenior

Responsibilities

  • Lead customer onboarding and optimization for ML training and serving solutions on TPU platforms.
  • Architect training and inference onboarding and optimization frameworks for customer workloads.
  • Collaborate with ML research, ML performance, model optimization tooling, and related optimization teams.
  • Ship stable-stack training and inference optimization solutions to customers.
  • Prepare and optimize large reference models for large-scale single-host and multi-host inference.

Requirements

  • Bachelor’s degree or equivalent practical experience.
  • At least 5 years of software development experience in one or more programming languages.
  • At least 2 years of experience leading ML design and optimizing ML infrastructure, including model deployment, evaluation, data processing, debugging, or fine-tuning.
  • At least 1 year of experience with training and inference techniques.
  • Experience optimizing machine learning models for large-scale training and inference workloads.
  • Experience with large-scale ML optimization techniques for improving latency and throughput.
  • Preferred: master’s degree or PhD in Computer Science or a related technical field.
  • Preferred: experience with TPUs, GPUs, or high-performance computing.

Tech Stack

Google Cloud
Google

About Google

10,000+ employees

Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.

Contact me