
Senior Software Engineer, AI Infrastructure
The Allen Institute for Artificial Intelligence4 days ago
Base Salary
$147k - $220k/yr
Responsibilities
- Design and scale the orchestration layer so high-value workloads receive GPU time.
- Build software-defined infrastructure and automation for researcher productivity and cluster health management.
- Own systems spanning the Beaker job scheduler through the execution runtime.
- Analyze complex distributed system failures and optimize distributed workloads for performance.
- Contribute to roadmaps for large-scale HPC compute, networking, and storage infrastructure.
- Review code and design documents, mentor team members, drive process improvements, and collaborate with research staff.
Requirements
- 8+ years of professional experience developing business-critical software and operating large-scale compute infrastructure.
- Proficiency in Go and/or Python is preferred.
- Bachelor’s degree in a related field; a relevant advanced degree may substitute for equivalent years of technical work experience.
- Expert-level knowledge of Linux internals and container runtimes such as Docker.
- Proven experience designing, debugging, and optimizing high-scale distributed systems and databases.
- Exceptional writing, communication, and consensus-building skills across researchers and engineers.
- Preferred experience with Kubernetes or Slurm, NCCL, InfiniBand, frontier AI model training or fine-tuning, HPC systems administration or SRE, open-source infrastructure, WEKA, or Ceph.
Benefits
- Medical, dental, vision, employee assistance, health savings, healthcare reimbursement, and flexible spending account plans.
- 401(k) plan, annual bonuses, and participation in a long-term incentive plan.
- $125 per month for commuting or internet expenses and $200 per month for fitness and wellbeing expenses.
- Up to 10 sick days, 7 personal days, 20 vacation days, and 12 paid holidays annually, plus family leave.
- Based in the Seattle office with on-site requirements varying by position and team.