2 days ago
Cupertino, CA, USAMid Level
H1B sponsor
Base Salary
$165k - $224k/yr
Responsibilities
- Enhance collective algorithms and topologies for optimal AI training performance.
- Use Neuron Explorer and related analysis tools to identify compute and bus bandwidth bottlenecks.
- Monitor and analyze processor, DMA, firmware, and workload metrics.
- Optimize collective operations to scale AI compute across data centers.
- Collaborate with hardware teams to co-optimize software and Trainium silicon.
- Develop and optimize C/C++ implementations of collective communication patterns.
- Investigate improvements for training topologies used by modern LLMs.
- Build and maintain analysis frameworks and automation solutions.
Requirements
- Experience building complex software systems successfully delivered to customers.
- Experience contributing to architecture and design, including design patterns, reliability, and scaling.
- Bachelor’s degree in computer science or equivalent.
- Knowledge of software, hardware, and network development lifecycle practices, including coding standards, code reviews, source control, builds, testing, certification, and live-site operations.
- Development experience within the last three years, or embedded development experience in C/C++.
- Preferred: master’s degree in computer science or equivalent.
- Preferred: experience with hardware/software integration and real-time systems.
- Preferred: familiarity with collective communication algorithms such as all-reduce and all-gather or with distributed training frameworks.
Benefits
- Comprehensive health insurance, including medical, dental, vision, prescription, basic life and AD&D insurance, and optional supplemental life plans.
- Employee assistance program, mental health support, medical advice line, flexible spending accounts, and adoption and surrogacy reimbursement coverage.
- 401(k) matching, paid time off, and parental leave.
- Sign-on payments and restricted stock units are included in the Amazon package.
- Flexible working hours and emphasis on work-life balance.
- Employee-led affinity groups, inclusion programs, learning experiences, mentorship, and career growth opportunities.
- Work location: Cupertino, California.
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.