17 hours ago
Cupertino, CA, USAMid Level
H1B sponsor
Base Salary
$165k - $224k/yr
Responsibilities
- Implement and tune distributed training components for large-scale pretraining, post-training, reinforcement learning, and fine-tuning workloads on Trainium.
- Develop and apply data, tensor, and pipeline parallelism strategies and reduced-precision formats.
- Profile workloads to identify compute, memory, collective, and host-overhead bottlenecks.
- Collaborate with compiler, runtime, kernel, and collectives engineers to implement performance fixes.
- Build and maintain internal tooling, benchmarks, and tests for reproducible performance work.
- Take on increasing technical ownership within the distributed training team.
Requirements
- Bachelor’s degree or above in computer science or equivalent experience.
- At least 3 years of full software development life cycle experience in production.
- At least 3 years of experience with a programming language such as Python, C/C++, or a similar language.
- At least 2 years of experience with system design, including design patterns, reliability, and scaling.
- Familiarity with LLM and transformer fundamentals, including attention mechanisms, autoregressive decoding, KV-cache behavior, and parallelism.
- Preferred: master’s degree or above in computer science or equivalent.
- Preferred: experience developing and deploying LLMs on GPUs, Neuron, TPU, or other AI acceleration hardware, or experience in computer architecture.
- Preferred: experience with PyTorch/JAX, distributed libraries and frameworks, reinforcement-learning frameworks, or end-to-end model training.
- Preferred: experience with workload profiling, performance characterization, optimization, and open source projects.
Benefits
- Comprehensive medical, dental, vision, prescription, life, AD&D, employee assistance, mental health, medical advice line, flexible spending, adoption, and surrogacy benefits.
- 401(k) matching, paid time off, and parental leave.
- Sign-on payments and restricted stock units are included in the compensation package.
- Flexible working hours with an emphasis on work-life balance.
- Employee-led affinity groups, learning experiences, and inclusion-focused programs.
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.