Amazon

Senior ML Kernel Performance Engineer

Amazon
Apply
2 months ago
Toronto, CanadaSenior

Responsibilities

  • Design and implement high-performance compute kernels for machine learning operations using the Neuron architecture and programming models.
  • Analyze and optimize kernel-level performance across multiple generations of Neuron hardware.
  • Use profiling tools to identify and resolve performance bottlenecks.
  • Implement compiler optimizations including fusion, sharding, tiling, and scheduling.
  • Work directly with customers to enable and optimize machine learning models on AWS accelerators.
  • Collaborate with compiler, runtime, framework, and hardware teams on kernel optimization techniques.
  • Create metrics and automation, resolve software defects, participate in design discussions and code reviews, and provide technical input to business decisions.

Requirements

  • At least 5 years of non-internship professional software development experience.
  • At least 5 years of programming experience with one or more software programming languages.
  • At least 5 years of experience leading the design or architecture of new and existing systems, including design patterns, reliability, and scaling.
  • Experience mentoring, serving as a tech lead, or leading an engineering team.
  • Preferred: at least 5 years of full software development lifecycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
  • Preferred: bachelor's degree in computer science or equivalent.
  • Preferred: expertise in ML or HPC accelerator architectures, GPU kernel optimization, GPGPU computing, NVIDIA PTX or AMD GPU ISA, high-performance libraries, low-level GPU optimization, LLVM/MLIR backend development, ML frameworks, parallel programming, and GPU memory hierarchies.

Benefits

  • Comprehensive benefits include medical, dental, vision, prescription, basic life and AD&D insurance, RRSP, DPSP, paid time off, and other health and well-being resources.
  • The position is based in Toronto, Ontario, Canada, with a listed base salary range of CAD 150,700.00–251,700.00 annually; total compensation may also include sign-on payments and RSUs.

Tech Stack

AWSPyTorchTensorFlow

Categories

Amazon

About Amazon

10,000+ employees

Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.

Contact me