1 day ago
Cupertino, CA, USAMid Level
H1B sponsor
Base Salary
$165k - $224k/yr
Responsibilities
- Design, develop, and optimize machine learning models and frameworks for deployment on custom ML accelerators.
- Build distributed inference support for PyTorch in the AWS Neuron SDK and tune models for AWS Trainium.
- Develop infrastructure to analyze and onboard models with diverse architectures.
- Design and implement high-performance NKI kernels and ML operation features.
- Profile and optimize system performance, memory usage, parallel execution, and hardware-specific workloads.
- Implement optimization techniques including fusion, sharding, tiling, and scheduling.
- Perform unit, end-to-end, and production testing and support continuous deployment and releases.
- Work directly with customers to enable and optimize their machine learning models on AWS accelerators.
- Collaborate across compiler, runtime, framework, hardware, and product teams and document designs, findings, and technical proposals.
Requirements
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
- At least 3 years of non-internship professional software development experience.
- At least 3 years of experience designing or architecting new and existing systems, including design patterns, reliability, and scaling.
- At least 1 year of experience designing and developing large-scale, multi-tiered, multi-threaded, embedded, or distributed software using C#, C++, Java, or Perl.
- Knowledge of Python and/or C++ programming.
- Experience debugging, profiling, and applying software engineering practices in large-scale systems.
- Strong understanding of system performance, memory management, and parallel computing.
- Preferred experience with machine learning and LLM fundamentals, model architecture, and inference.
- Preferred experience developing performant ML kernels with CUDA, Triton, or FlashInfer.
- Preferred experience with vLLM, SGLang, TensorRT, PyTorch, JIT compilation, and AOT tracing.
Benefits
- Comprehensive health coverage including medical, dental, vision, prescription, life and AD&D insurance, an employee assistance program, mental health support, a medical advice line, and flexible spending accounts.
- 401(k) matching, paid time off, parental leave, and adoption and surrogacy reimbursement coverage.
- Sign-on payments and restricted stock units may be included in the Amazon compensation package.
- The position is located in Cupertino, California.
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.