2 days ago
Cupertino, CA, USAMid Level
H1B sponsor
Base Salary
$165k - $224k/yr
Responsibilities
- Design, develop, and optimize ML models and frameworks for deployment on custom ML accelerators.
- Build distributed inference support for PyTorch in the Neuron SDK and tune models for AWS Trainium.
- Develop high-performance NKI kernels and infrastructure for analyzing and onboarding diverse model architectures.
- Profile and optimize system performance across Neuron hardware generations using techniques including fusion, sharding, tiling, and scheduling.
- Perform unit, end-to-end, deployment, and production testing while participating in the full software lifecycle.
- Work directly with customers to enable and optimize their machine learning models on AWS accelerators.
- Collaborate across compiler, runtime, framework, hardware, and open-source teams and communicate technical findings through designs and documentation.
Requirements
- At least 3 years of non-internship professional software development experience.
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
- Knowledge of Python and/or C++ programming.
- Preferred experience with the full software development lifecycle, including coding standards, code reviews, source control, build processes, testing, and operations.
- Preferred knowledge of ML and LLM fundamentals, model architectures, inference, training lifecycles, and model execution optimization.
- Preferred experience with CUDA or other ML/low-level kernels and tile-level semantics similar to Triton.
- Preferred production experience with vLLM, SGLang, TensorRT, or similar platforms.
- Preferred experience with PyTorch, JIT compilation, and AOT tracing.
Benefits
- Base salary range of $165,200.00 to $223,600.00 annually, plus sign-on payments and RSUs.
- Benefits include medical, dental, vision, prescription, life and AD&D insurance, an employee assistance program, mental health support, a medical advice line, flexible spending accounts, adoption and surrogacy reimbursement, 401(k) matching, paid time off, and parental leave.
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.