Amazon

Machine Learning Performance Engineer, Annapurna Labs

Amazon
Apply
1 day ago
Tel Aviv-Yafo, IsraelMid Level

Responsibilities

  • Design and implement high-performance compute kernels for ML operations using the Neuron architecture and programming models.
  • Profile ML workloads end-to-end, identify memory, compute, and communication bottlenecks, and drive measured performance improvements.
  • Improve the Neuron programming model, tooling, debugging workflows, compiler, runtime, and framework integrations.
  • Identify optimization opportunities across the Neuron software stack and collaborate with compiler, runtime, framework, chip design, hardware, and customer teams.
  • Document software designs, operational runbooks, performance findings, and optimization results.

Requirements

  • 3+ years of non-internship professional software development experience.
  • Knowledge of Python and/or C++ programming.
  • Knowledge of computer architecture, operating systems, and parallel computing.
  • Experience with PyTorch, TensorFlow, and/or JAX.
  • Preferred: a master's degree in Computer Science, Engineering, Mathematics, or a related field.
  • Preferred: experience optimizing LLM, vision, or other deep-learning models.
  • Preferred: experience with kernel writing or parallel programming, including CUDA, Triton, CUTLASS, Pallas, Mojo, SIMD, or MPI.
  • Preferred: experience with compiler optimization or hardware-software co-design.

Tech Stack

Categories

Amazon

About Amazon

10,000+ employees

Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.

Contact me