Amazon

Sr. ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs

Amazon
Apply
2 days ago
Cupertino, CA, USASenior
H1B Sponsor

Base Salary

$193k - $262k/yr

Responsibilities

  • Design and implement high-performance compute kernels for machine-learning operations using Neuron architectures and programming models.
  • Analyze and optimize kernel-level performance across multiple generations of Neuron hardware.
  • Use profiling tools to identify and resolve performance bottlenecks.
  • Implement compiler optimizations including fusion, sharding, tiling, and scheduling.
  • Work directly with customers to enable and optimize machine-learning models on AWS accelerators.
  • Collaborate with compiler, runtime, framework, and hardware teams on kernel optimization techniques.
  • Architect and implement business-critical features, publish research, and mentor experienced engineers.

Requirements

  • 5+ years of non-internship professional software development experience.
  • 5+ years of programming experience with at least one software programming language.
  • 5+ years of experience leading the design or architecture of new and existing systems.
  • 5+ years of full software development lifecycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
  • Experience as a mentor, tech lead, or engineering team lead.
  • Preferred: bachelor’s degree in computer science or equivalent.
  • Preferred: 6+ years of full software development experience.
  • Preferred: expertise in ML or HPC accelerator architectures, GPU kernel optimization, GPGPU computing, high-performance libraries, low-level GPU performance optimization, parallel programming, and GPU memory hierarchies.
  • Preferred: experience with CUDA, NKI, Triton, OpenCL, SYCL, ROCm, NVIDIA PTX, AMD GPU ISA, LLVM/MLIR backend development, PyTorch, TensorFlow, and GPU backends.

Benefits

  • Health insurance including medical, dental, vision, prescription, Basic Life and AD&D insurance, and supplemental life plan options.
  • Employee assistance and mental health support, medical advice line, and flexible spending accounts.
  • 401(k) matching, paid time off, and parental leave.
  • Adoption and surrogacy reimbursement coverage.
  • The team offers flexibility in working hours and emphasizes work-life balance.
  • Position is based in Cupertino, California.
  • Base salary range is $193,300.00–$261,500.00 USD annually; sign-on payments and restricted stock units may also be included.

Tech Stack

AWSPyTorchTensorFlow

Categories

Amazon

About Amazon

10,000+ employees
Contact me