1 day ago
Base Salary
$263k - $355k/yr
Responsibilities
- Define and build the architecture for cloud-based AI inference services.
- Develop Kubernetes controllers and platform capabilities for workload deployment, scheduling, recovery, scaling, upgrades, and lifecycle management.
- Establish practices for health validation, progressive rollout, rollback, observability, service objectives, capacity planning, and incident response.
- Improve platform reliability, scalability, performance, and resource efficiency.
- Lead production readiness reviews and resolve complex issues across services, Kubernetes, networking, and compute infrastructure.
- Lead design and build reviews, mentor engineers, and drive technical alignment across teams.
Requirements
- 8+ years of experience, or equivalent proven impact, building distributed systems, cloud platforms, or production infrastructure.
- Deep production experience with Kubernetes, including controllers, operators, scheduling, resource management, networking, and workload lifecycle management.
- Hands-on programming experience with Go, C++, Rust, Python, or a similar language.
- Strong software and production engineering experience with reliable services, APIs, concurrency, observability, deployment safety, capacity planning, and incident response.
- Track record of leading complex technical initiatives while remaining hands-on in architecture, implementation, debugging, mentoring, and cross-team technical influence.
- Ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.
- Preferred: experience with AI infrastructure, model serving, or accelerator-backed workloads.
- Preferred: familiarity with PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM, or experience qualifying accelerators and tuning distributed workloads.
- Preferred: knowledge of inference performance and resource-efficiency considerations.
Benefits
- Relocation package, including visa sponsorship support, is available for candidates who require it.
- Hybrid working arrangements are determined by each group or team, with role-specific details shared upon application.
- Competitive and equitable rewards and a total reward package shared during the recruitment process.
- Accommodation and adjustment support is available during the recruitment process.
About Arm
Arm’s foundational technology is defining the future of computing. A future built by the greatest technology ecosystem in the world. A future built on Arm. Arm is everywhere technology matters. Technology matters everywhere. Together, we’ll power every technology revolution moving forward, including cloud computing, automotive and autonomous systems, IoT, the metaverse, and beyond. Changing the world. Again. On Arm.