2 months ago
Base Salary
$209k - $283k/yr
Responsibilities
- Define and build architecture for cloud-based AI inference services.
- Develop Kubernetes controllers and platform capabilities for workload deployment, scheduling, recovery, scaling, upgrades, and lifecycle management.
- Establish production practices for health validation, progressive rollout, rollback, observability, and service objectives.
- Improve platform reliability, scalability, performance, and resource efficiency.
- Lead production readiness reviews and resolve complex issues across services, Kubernetes, networking, and compute infrastructure.
- Turn incidents and operational bottlenecks into durable platform improvements.
- Lead design and build reviews, mentor engineers, and drive technical alignment across teams.
Requirements
- 5+ years of experience, or equivalent proven impact, building distributed systems, cloud platforms, or production infrastructure.
- Deep production experience with Kubernetes, including controllers, operators, scheduling, resource management, networking, and workload lifecycle management.
- Hands-on programming experience in Go, C++, Rust, Python, or a similar language.
- Experience building reliable services and APIs, with concurrency, observability, deployment safety, capacity planning, and incident response.
- A track record of leading complex technical initiatives while remaining hands-on across architecture, implementation, debugging, mentoring, and technical influence.
- Ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.
- Preferred experience with AI infrastructure, model serving, accelerator-backed workloads, or qualifying accelerators and tuning distributed workloads.
- Preferred familiarity with PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM and knowledge of inference performance and resource efficiency.
Benefits
- Relocation package including visa sponsorship support is available for candidates who require it.
- Hybrid working patterns are determined by the team, with role-specific details shared during the application process.
- Collaborative environment within Arm’s AI Platforms team with opportunities to shape foundational AI inference capabilities.
- Competitive and equitable total reward package, with details shared during recruitment.
About Arm
Arm’s foundational technology is defining the future of computing. A future built by the greatest technology ecosystem in the world. A future built on Arm. Arm is everywhere technology matters. Technology matters everywhere. Together, we’ll power every technology revolution moving forward, including cloud computing, automotive and autonomous systems, IoT, the metaverse, and beyond. Changing the world. Again. On Arm.