Vultr

Staff AI/ML Infrastructure Engineer

Vultr
Apply
5 months ago
Remote, United StatesStaff+

Base Salary

$145k - $160k/yr

Responsibilities

  • Design and maintain GPU and bare metal infrastructure in containerized and physical environments.
  • Build scalable GPU clusters in partnership with networking and provisioning teams.
  • Ensure reliable, high-performance provisioning of GPU infrastructure.
  • Develop automated testing systems for GPU-based platforms.
  • Implement infrastructure solutions for diverse AI/ML workloads.
  • Benchmark, test, and troubleshoot GPU performance at scale.
  • Collaborate with hardware vendors on drivers, firmware, and support.
  • Resolve hardware, software, and performance issues across environments.
  • Optimize rail and cluster performance across architectures.
  • Lead technical direction and mentor engineers on infrastructure best practices.

Requirements

  • At least 5 years of experience with bare metal infrastructure and hardware automation.
  • Hands-on experience with modern NVIDIA and AMD GPU platforms and high-performance networking including RoCE and InfiniBand.
  • Deep knowledge of BIOS, BMC, firmware, NICs, Redfish/IPMI, and PCIe systems.
  • Strong Linux systems experience, including device drivers and package management.
  • Experience building infrastructure automation with Python and Bash.
  • Familiarity with GPU drivers, firmware ecosystems, and vendor collaboration.
  • Experience designing and delivering complex infrastructure products.
  • Proven ability to lead projects and mentor engineers.
  • Experience optimizing multi-cluster GPU environments.
  • Exposure to machine learning software stacks and GPU workloads.

Benefits

  • 100% company-paid medical, dental, and vision insurance premiums.
  • 401(k) plan with 100% matching up to 4% and immediate vesting.
  • $2,500 annual professional development reimbursement.
  • 11 holidays, paid time off accrual, and rollover plan.
  • Increased PTO at three- and ten-year anniversaries, a one-month paid sabbatical every five years, and an annual anniversary bonus.
  • $500 remote office setup stipend in the first year and $400 each following year.
  • Internet reimbursement up to $75 per month.
  • Gym membership reimbursement up to $50 per month.
  • Company-paid Wellable subscription.

Tech Stack

Categories

Vultr

About Vultr

201-500 employees
Contact me