Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives
Amazon1 day ago
Cupertino, CA, USAMid Level
H1B sponsor
Base Salary
$165k - $224k/yr
Responsibilities
- Build and optimize low-level data-movement software for transferring KV cache and activations across accelerators, servers, and heterogeneous memory.
- Profile real workloads, identify performance bottlenecks, and optimize components toward theoretical hardware limits.
- Work across network transport, inference frameworks, chip, runtime, and model layers.
- Deliver production features for large AWS clusters and AI/ML customers.
- Collaborate with HPC and ML customers and participate in code reviews, testing, and software delivery.
Requirements
- 3+ years of non-internship professional software development experience.
- 2+ years of non-internship experience designing or architecting new and existing systems, including design patterns, reliability, and scaling.
- Programming experience in at least one software programming language, including C/C++.
- Strong command of Linux, memory systems, and performance-critical software development.
- Preferred: 3+ years of full software development lifecycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Preferred: exposure to high-speed networking, HPC interconnects, GPU or accelerator systems, or embedded systems.
- Preferred: Bachelor's degree in computer science or equivalent.
Benefits
- Flexible working hours and emphasis on work-life balance.
- Mentorship, knowledge-sharing, code reviews, and career-growth opportunities.
- Health, dental, vision, prescription, life, AD&D, EAP, mental health support, medical advice line, flexible spending accounts, adoption and surrogacy reimbursement, 401(k) matching, paid time off, and parental leave.
- The role is based in Cupertino, California, and includes sign-on payments and restricted stock units in addition to base compensation.
About Amazon
Amazon builds and operates a global e-commerce marketplace, logistics network, and consumer devices, and provides cloud computing via AWS for businesses and developers. The company earns revenue from online retail, third‑party seller services, subscriptions like Prime, advertising, and AWS usage. Founded in 1994 and headquartered in Seattle, it is publicly traded on NASDAQ (AMZN) and serves customers in dozens of countries.