1 day ago
Base Salary
$193k - $262k/yr
Responsibilities
- Lead optimization of distributed training performance on AWS Trainium across the AWS Neuron software stack.
- Enable and tune large-scale model training across PyTorch, JAX, the Neuron compiler, and runtime.
- Bring up new model architectures by identifying missing operators, sharding strategies, and numerics, then optimize them for performance.
- Own data, tensor, pipeline, expert, and context parallelism strategies and apply reduced-precision formats where beneficial.
- Profile end-to-end workloads and drive fixes for compute, memory, collective, and host-overhead bottlenecks.
- Architect and implement business-critical features, create metrics and automation, debug software defects, and optimize memory usage.
- Collaborate with compiler, runtime, collectives, applied science, systems, and product teams, as well as customers and open-source communities.
- Mentor experienced engineers and translate performance gaps into requirements for future Trainium architectures.
Requirements
- Bachelor's degree in computer science or equivalent.
- At least 5 years of non-internship professional software development experience.
- At least 5 years of programming experience with at least one software programming language.
- At least 5 years of experience leading the design or architecture of new and existing systems, including design patterns, reliability, and scaling.
- At least 5 years of full software development lifecycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
- Experience mentoring, serving as a tech lead, or leading an engineering team.
- Experience in machine learning, data mining, information retrieval, statistics, or natural language processing.
- Preferred: master's degree in computer science or equivalent.
- Preferred: computer architecture experience and software engineering expertise with PyTorch, JAX, TensorFlow, distributed libraries and frameworks, and end-to-end model training.
Benefits
- Comprehensive health coverage including medical, dental, vision, prescription, life and AD&D insurance, employee assistance, mental health support, medical advice, flexible spending accounts, and adoption and surrogacy reimbursement.
- 401(k) matching, paid time off, and parental leave.
- Sign-on payments and restricted stock units are included in the Amazon package.
- The position is based in Cupertino, California; no remote or hybrid arrangement is stated.
Tech Stack
PyTorchTensorFlow
Categories
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.