17 hours ago
Cupertino, CA, USAMid Level
H1B sponsor
Base Salary
$165k - $224k/yr
Responsibilities
- Design, develop, and optimize machine learning models and frameworks for deployment on custom ML hardware accelerators.
- Build distributed inference support and infrastructure for onboarding and analyzing diverse model architectures.
- Design and implement high-performance kernels and ML operation features using Neuron programming models.
- Profile and optimize system performance, memory usage, latency, throughput, sharding, tiling, fusion, and scheduling across Neuron hardware generations.
- Perform unit, end-to-end, production, and pipeline-based testing and releases.
- Enable and optimize customer machine learning models on AWS Trainium and Inferentia accelerators.
- Collaborate across compiler, runtime, framework, hardware, applied science, and product teams and contribute to design reviews, code reviews, automation, and defect resolution.
Requirements
- Bachelor's degree in computer science or equivalent.
- At least 3 years of non-internship professional software development experience.
- At least 3 years of non-internship experience designing or architecting new and existing systems, including design patterns, reliability, and scaling.
- Fundamental knowledge of machine learning and LLM architectures, training and inference lifecycles, and model execution optimization.
- Software development experience in C++ or Python.
- Strong understanding of system performance, memory management, parallel computing, computer architecture, and operating-system-level software.
- Proficiency in debugging, profiling, and software engineering practices for large-scale systems.
- Preferred: master's degree or Ph.D. in computer science or equivalent.
- Preferred: experience with PyTorch, JIT compilation, AOT tracing, CUDA or equivalent kernels, CUTLASS, FlashInfer, Triton-like tile-level semantics, and production inference serving with vLLM, SGLang, TensorRT, or similar platforms.
Benefits
- Comprehensive medical, dental, vision, prescription, life, AD&D, employee assistance, mental health, medical advice line, flexible spending, adoption, and surrogacy benefits.
- 401(k) matching, paid time off, and parental leave.
- Sign-on payments and restricted stock units are included in the Amazon package.
- Position is based in Cupertino, California; the posting does not state a remote or hybrid arrangement.
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.