Amazon

Senior ML Kernel Performance Engineer

Amazon
Apply
24 hours ago
Toronto, CanadaSenior
H1B Sponsor

Responsibilities

  • Design and implement high-performance compute kernels for machine learning operations using the Neuron architecture and programming models.
  • Analyze and optimize kernel-level performance across multiple generations of Neuron hardware.
  • Use profiling tools to identify and resolve performance bottlenecks.
  • Implement compiler optimizations including fusion, sharding, tiling, and scheduling.
  • Work directly with customers to enable and optimize machine learning models on AWS accelerators.
  • Collaborate with compiler, runtime, framework, and hardware teams on kernel optimization techniques.
  • Create metrics and automation, resolve software defects, participate in design discussions and code reviews, and provide technical input to business decisions.

Requirements

  • At least 5 years of non-internship professional software development experience.
  • At least 5 years of programming experience with one or more software programming languages.
  • At least 5 years of experience leading the design or architecture of new and existing systems, including design patterns, reliability, and scaling.
  • Experience mentoring, serving as a tech lead, or leading an engineering team.
  • Preferred: at least 5 years of full software development lifecycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
  • Preferred: bachelor's degree in computer science or equivalent.
  • Preferred: expertise in ML or HPC accelerator architectures, GPU kernel optimization, GPGPU computing, NVIDIA PTX or AMD GPU ISA, high-performance libraries, low-level GPU optimization, LLVM/MLIR backend development, ML frameworks, parallel programming, and GPU memory hierarchies.

Benefits

  • Comprehensive benefits include medical, dental, vision, prescription, basic life and AD&D insurance, RRSP, DPSP, paid time off, and other health and well-being resources.
  • The position is based in Toronto, Ontario, Canada, with a listed base salary range of CAD 150,700.00–251,700.00 annually; total compensation may also include sign-on payments and RSUs.

Tech Stack

AWSPyTorchTensorFlow

Categories

Amazon

About Amazon

10,000+ employees
Contact me