Amazon

Software Development Engineer I, Inference models optimization, AWS Neuron Inference

Amazon
Apply
2 days ago
Cupertino, CA, USAEntry Level
H1B sponsor

Base Salary

$127k - $185k/yr

Responsibilities

  • Optimize open models for AWS Trainium, including model sharding, NKI kernel development, and accuracy validation.
  • Develop software that enables and optimizes custom machine learning accelerator silicon in collaboration with hardware, firmware, compiler, runtime, and ML engineers.
  • Write maintainable systems-level and performance-critical code using C/C++, Python, or Rust.
  • Participate in code reviews, technical documentation, and deployment of agentic tools for model enablement.
  • Monitor, debug, and resolve issues across hardware-software integration boundaries, including on-call support.
  • Develop, enable, and performance-tune LLM model families and distributed inference solutions.
  • Support customers and open-source ecosystems in enabling and optimizing machine learning workloads on Trainium.

Requirements

  • Experience implementing data structures, developing basic algorithms, and/or applying object-oriented design principles.
  • Currently holds or is pursuing a bachelor's degree or higher in computer science, computer engineering, electrical engineering, or a related field.
  • Experience programming in a language such as Python, Java, or C++.
  • Preferred: prior technical internships or demonstrated project experience.
  • Preferred: experience with compiler design or optimization, computer architecture, hardware simulation or emulation, ML frameworks, performance profiling, Linux kernel or embedded systems, AI development tools, or cloud platforms, preferably AWS.
  • Preferred: strong debugging and problem-solving ability across hardware-software boundaries and the ability to learn new technologies quickly.

Benefits

  • Amazon offers health insurance, including medical, dental, vision, prescription, basic life and AD&D insurance, supplemental life plan options, an employee assistance program, mental health support, a medical advice line, flexible spending accounts, and adoption and surrogacy reimbursement.
  • Benefits include 401(k) matching, paid time off, and parental leave.
  • The compensation package may include sign-on payments and restricted stock units.
Amazon

About Amazon

10,000+ employees

Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.

Contact me