3 days ago
Base Salary
$240k - $325k/yr
Responsibilities
- Define the long-term technical direction for a globally distributed, high-performance ML inference platform serving Amazon Bedrock customers.
- Own end-to-end system architecture decisions affecting latency, reliability, scalability, security, and cost.
- Design and evolve Mantle’s distributed inference engine, including capacity management, model onboarding pipelines, and quality-of-service controls.
- Lead cross-organizational initiatives across AWS teams to deliver OpenAI-compatible APIs with Zero Operator Access security guarantees.
- Develop technical strategy for onboarding new foundation models while maintaining global availability and performance SLAs.
- Author technical vision documents, influence product roadmaps, and represent the team in executive architectural reviews.
- Mentor and develop principal and senior engineers and raise engineering standards across the AWS engineering community.
Requirements
- 15+ years of non-internship professional software development experience.
- Experience with object-oriented design, data structures, and algorithms.
- Experience owning technical strategy, end-to-end delivery, and partnerships with senior leadership.
- Proven ability to provide technical and strategic oversight for a high-performing global team of hundreds of engineers.
- 10+ years of experience mentoring and growing engineers.
- Preferred: 20+ years of deep hands-on experience building complex distributed systems.
- Preferred: experience delivering durable, scalable solutions with multi-year, multi-billion-dollar, and multi-organization impact.
- Preferred: ability to inspire and influence engineering graduates through VPs, SVPs, and CTOs.
- Preferred: published research or patents in relevant technical areas.
- Master’s or PhD preferred.
Benefits
- Comprehensive health coverage including medical, dental, vision, prescription, Basic Life and AD&D insurance, and optional supplemental life plans.
- Employee assistance program, mental health support, medical advice line, flexible spending accounts, and adoption and surrogacy reimbursement coverage.
- 401(k) matching, paid time off, and parental leave.
- Sign-on payments and restricted stock units are included in the overall Amazon package.
- The position is located in Seattle, Washington, USA.