Arm

Principal Software Engineer, AI Compute Infrastructure

Arm
Apply
24 hours ago

Base Salary

$263k - $355k/yr

Responsibilities

  • Build and operate Kubernetes clusters, improving workload scheduling, topology-aware placement, capacity utilization, and recovery.
  • Enable CPU and GPU systems by integrating and validating drivers, networking, storage, monitoring, and health checks.
  • Investigate performance and reliability issues across applications, cloud infrastructure, clusters, and hardware, converting findings into lasting improvements.
  • Partner with AI teams to understand workloads and automate cluster provisioning, upgrades, monitoring, and maintenance.

Requirements

  • 8+ years of experience building or operating cloud, compute, HPC, or distributed infrastructure in a production environment.
  • Programming experience in Go, Python, or another systems language, with an interest in developing reliable infrastructure software.
  • Practical knowledge of Kubernetes, containers, Linux, networking, and storage.
  • Experience supporting GPU, accelerator, or distributed machine-learning workloads.
  • Ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.
  • Preferred: familiarity with Kubernetes scheduling, operators, quotas, or resource management.
  • Preferred: experience with NVIDIA CUDA, NVLink, NVSwitch, NCCL, EFA, or DCGM.
  • Preferred: knowledge of AWS EKS, Terraform, Argo CD, Helm, Prometheus, or Grafana.
  • Preferred: familiarity with PyTorch, Ray, vLLM, SGLang, or TensorRT-LLM, or experience qualifying accelerators and tuning distributed workloads.

Benefits

  • Relocation package, including visa sponsorship support, is available for candidates who require it.
  • Hybrid working patterns are determined by the team, with role-specific details provided during the application process.

Tech Stack

Argo CDAWSGoGrafanaHelmKubernetesLinuxPrometheusPythonPyTorchTerraform

Categories

Arm

About Arm

5,001-10,000 employees

Arm’s foundational technology is defining the future of computing. A future built by the greatest technology ecosystem in the world. A future built on Arm. Arm is everywhere technology matters. Technology matters everywhere. Together, we’ll power every technology revolution moving forward, including cloud computing, automotive and autonomous systems, IoT, the metaverse, and beyond. Changing the world. Again. On Arm.

Contact me