Principal Engineer: Annapurna Labs Training and Inference , Annapurna Labs, AWS Neuron SDK
Amazon3 days ago
Base Salary
$200k - $311k/yr
Responsibilities
- Drive AI model performance across pre-training, post-training and alignment, and inference serving on AWS Trainium.
- Optimize ML training kernels, forward and backward paths, training collectives, all-reduce, and cross-accelerator coordination.
- Build and optimize supervised fine-tuning, preference optimization, reinforcement learning, alignment, reward modeling, and convergence safeguards.
- Develop inference optimization strategies for Trainium to improve model-serving cost, latency, compute utilization, and memory-bandwidth utilization.
- Influence hardware-software co-design with Annapurna chip architecture teams based on production model-serving requirements.
- Lead demanding cross-functional projects, make binding technical decisions, decompose complex problems, mentor senior engineers, and raise engineering standards.
- Collaborate with AWS customers, internal science teams, EC2, EKS, VPC, Bedrock, and HyperPod partner teams to enable and scale AI models.
Requirements
- 10+ years of non-internship professional software development experience.
- 7+ years of experience with distributed training or reinforcement-learning systems at scale.
- Strong C/C++ and Python skills.
- Experience with AI/ML model execution, inference serving, or compiler optimization.
- Experience providing technical leadership and mentorship to engineering teams.
- Preferred: expertise in model architecture and distributed training, post-training methods and alignment, inference optimization and LLM serving on custom accelerators, ML/post-training framework development, compiler/graph/kernel optimization and numerical debugging, or adjacent EDA, video-pipeline, GPU-graphics, or HPC experience.
- Preferred: experience with transformers, MoE, diffusion, SFT, RLHF/RLAIF, DPO/IPO/KTO, reward modeling, PPO/GRPO, JAX, PyTorch/XLA, TRL, veRL, NeMo-Aligner, TorchTitan, or TorchAO.
Benefits
- Comprehensive health insurance including medical, dental, vision, prescription, Basic Life & AD&D insurance, and optional supplemental life plans.
- Employee assistance, mental health support, medical advice line, flexible spending accounts, and adoption and surrogacy reimbursement coverage.
- 401(k) matching, paid time off, and parental leave.
- Sign-on payments and restricted stock units are included in the Amazon package.
- The role is listed in Cupertino, California and Seattle, Washington; the posting does not specify a remote or hybrid arrangement.
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.