17 hours ago
Base Salary
$193k - $262k/yr
Responsibilities
- Build distributed training and post-training support for PyTorch and JAX on Trainium accelerators.
- Develop and own data, tensor, pipeline, expert, and context parallelism strategies for large-scale models.
- Optimize training, post-training, and reinforcement learning workloads using reduced-precision formats where appropriate.
- Profile workloads end to end to identify compute, memory, collective, network, or host overhead bottlenecks.
- Coordinate with compiler, runtime, collectives, and framework engineers to implement performance fixes.
- Translate performance findings into framework requirements and contribute to upstream open-source projects.
Requirements
- 5+ years of non-internship professional software development experience.
- 5+ years of programming experience with at least one software programming language.
- 5+ years of leading the design or architecture of new and existing systems, including reliability and scaling.
- Experience mentoring, serving as a tech lead, or leading an engineering team.
- Bachelor's degree or above in computer science or equivalent.
- Familiarity with LLM and transformer fundamentals, including attention mechanisms, autoregressive decoding, V-cache behavior, and parallelism.
- Experience in machine learning, data mining, information retrieval, statistics, or natural language processing.
- Preferred: master's degree or above in computer science or equivalent.
- Preferred: experience developing and deploying LLMs in production on GPUs, Neuron, TPU, or other AI acceleration hardware, or experience in computer architecture.
- Preferred: hands-on SFT, RLHF, PPO, or DPO experience.
- Preferred: experience with PyTorch, JAX, distributed libraries and frameworks, reinforcement learning frameworks, or end-to-end model training.
- Preferred: performance engineering experience involving workload profiling, characterization, and optimization.
- Preferred: contributions to open-source projects.
Benefits
- Comprehensive health insurance, including medical, dental, vision, prescription, life, and AD&D coverage.
- 401(k) matching, paid time off, parental leave, adoption and surrogacy reimbursement, employee assistance, mental health support, and flexible spending accounts.
- Flexible working hours and an emphasis on work-life balance.
- Position located in Cupertino, California.
- Additional compensation may include sign-on payments and restricted stock units; compensation details are excluded from this benefits summary.
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.