1 day ago
Base Salary
$168k - $227k/yr
Responsibilities
- Develop core building blocks for LLM inference, including Attention, MLP, Quantization, Speculative Decoding, and Mixture of Experts.
- Optimize inference performance and accuracy on AWS Neuron devices.
- Adapt the latest LLM optimization research to Neuron chips.
- Optimize open-source and internally developed models.
- Collaborate with chip architects, compiler engineers, runtime engineers, and other teams.
- Lead software design and architecture and mentor engineers or serve as a technical lead.
Requirements
- 5+ years of non-internship professional software development experience.
- 5+ years of programming experience with at least one software programming language.
- 5+ years of experience leading the design or architecture of new and existing systems, including design patterns, reliability, and scaling.
- Experience as a mentor, tech lead, or engineering team lead.
- Preferred: 5+ years of full software development lifecycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Preferred: bachelor’s degree in computer science or equivalent.
Benefits
- Comprehensive health insurance, including medical, dental, vision, and prescription coverage.
- Basic Life & AD&D insurance and optional supplemental life plans.
- Employee Assistance Program, mental health support, and a medical advice line.
- Flexible Spending Accounts.
- Adoption and surrogacy reimbursement coverage.
- 401(k) matching.
- Paid time off and parental leave.
- Sign-on payments and restricted stock units are included in the overall package.
- Position located in Seattle, Washington, USA.
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.