1 day ago
Cupertino, CA, USAMid Level
H1B sponsor
Base Salary
$165k - $224k/yr
Responsibilities
- Implement and tune distributed training components for large-scale training, post-training, and reinforcement learning workloads on AWS Trainium.
- Develop parallelism strategies including data, tensor, and pipeline parallelism and apply reduced-precision formats.
- Profile workloads to identify compute, memory, collective, and host-overhead bottlenecks.
- Collaborate with compiler, runtime, and collectives engineers to deliver performance improvements.
- Build and maintain internal tooling, benchmarks, and tests for reproducible performance work.
Requirements
- Bachelor's degree or above in computer science or equivalent.
- At least 2 years of experience designing or architecting new and existing systems, including design patterns, reliability, and scaling.
- At least 3 years of full software development lifecycle experience in production.
- At least 3 years of experience with Python, C/C++, or a similar programming language.
- Familiarity with LLM and transformer fundamentals, including attention mechanisms, autoregressive decoding, KV-cache behavior, and parallelism.
- Preferred: master's degree or above in computer science or equivalent.
- Preferred: experience developing and deploying LLMs in production on GPUs, Neuron, TPUs, or other AI acceleration hardware, or experience in computer architecture.
- Preferred: experience with PyTorch, JAX, distributed libraries and frameworks, reinforcement learning frameworks, or end-to-end model training.
- Preferred: performance engineering experience involving workload profiling, characterization, and optimization.
- Preferred: experience with open-source projects.
Benefits
- Comprehensive benefits include medical, dental, vision, prescription, life and AD&D insurance, employee assistance and mental health support, flexible spending accounts, adoption and surrogacy reimbursement, 401(k) matching, paid time off, and parental leave.
- The compensation package may include sign-on payments and restricted stock units.
- The team offers flexibility in working hours and emphasizes work-life balance.
- Work location: Cupertino, California, USA.
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.