18 hours ago
Cupertino, CA, USAMid Level
H1B sponsor
Base Salary
$165k - $224k/yr
Responsibilities
- Design, develop, and optimize machine learning models and frameworks for deployment on custom ML accelerators.
- Build distributed inference support for PyTorch and infrastructure to analyze and onboard models with diverse architectures.
- Design and implement high-performance NKI kernels and ML operation features for the Neuron architecture.
- Profile and optimize system performance, memory usage, and hardware-specific execution across multiple Trainium generations.
- Implement optimizations including fusion, sharding, tiling, and scheduling.
- Perform unit, end-to-end, and production testing with continuous deployment and release pipelines.
- Work directly with customers to enable and optimize their machine learning models on AWS accelerators.
- Collaborate across compiler, runtime, framework, hardware, and customer teams and document technical findings.
Requirements
- At least 3 years of non-internship professional software development experience.
- At least 3 years of experience designing or architecting new and existing systems, including design patterns, reliability, and scaling.
- At least 1 year of experience developing large-scale, multi-tiered, multi-threaded, embedded, or distributed software using C#, C++, Java, or Perl.
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
- Experience debugging, profiling, and applying software engineering practices in large-scale systems.
- Knowledge of machine learning and large language model fundamentals, including model architecture, training and inference lifecycles, and execution optimization.
- Knowledge of Python and/or C++ and strong understanding of system performance, memory management, and parallel computing.
- Preferred qualifications include CUDA or low-level kernel development, CUTLASS, FlashInfer, vLLM, SGLang, TensorRT, Triton-like tile semantics, computer architecture, operating systems, PyTorch, JIT compilation, and AOT tracing.
Benefits
- Comprehensive medical, dental, vision, prescription, life, AD&D, EAP, mental health, and medical advice benefits.
- 401(k) matching, paid time off, parental leave, and adoption and surrogacy reimbursement coverage.
- Sign-on payments and restricted stock units are included in the Amazon package.
- The position is based in Cupertino, California.
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.