Member of Technical Staff - GPU Infrastructure
Prime Intellect4 months ago
Remote, United States +2 moreMid Level
H1B sponsor
Base Salary
$150k - $300k/yr
Responsibilities
- Partner with customers to understand workload requirements and design GPU cluster architectures for deployments ranging from 100 to 10,000+ GPUs.
- Create technical proposals, capacity plans, and deployment strategies for LLM training, inference, and HPC workloads.
- Deploy and configure SLURM and Kubernetes for distributed GPU workloads.
- Implement InfiniBand, RoCE, NVLink, and parallel filesystems including Lustre, BeeGFS, and GPFS.
- Optimize GPU utilization, memory management, inter-node communication, Linux kernel parameters, and CUDA configurations.
- Serve as the primary technical escalation point and diagnose issues across hardware, drivers, networking, and software.
- Implement monitoring, alerting, and automated remediation systems and provide 24/7 on-call support.
- Create runbooks and documentation for customer operations teams.
Requirements
- At least 3 years of hands-on experience with GPU clusters and HPC environments.
- Deep production expertise with SLURM and Kubernetes in GPU settings.
- Proven experience configuring and troubleshooting InfiniBand.
- Strong understanding of NVIDIA GPU architecture, CUDA, and the driver stack.
- Experience with Ansible and Terraform for infrastructure automation.
- Proficiency in Python, Bash, and systems programming.
- Track record of customer-facing technical leadership.
- Experience with NVIDIA drivers, Fabric Manager, DCGM, Docker, Containerd, Enroot, Linux kernel tuning, network topology design, and high-density GPU power and cooling requirements.
- Preferred qualifications include experience with 1,000+ GPU deployments; NVIDIA DGX, HGX, or SuperPOD certification; PyTorch FSDP, DeepSpeed, or Megatron-LM; ML framework optimization and profiling; AMD MI300 or Intel Gaudi accelerators; and open-source HPC or AI infrastructure contributions.
Benefits
- Cash compensation of $150-300k with significant equity incentives.
- Flexible work arrangement with remote work or a San Francisco office option.
- Full visa sponsorship and relocation support.
- Professional development budget for courses and conferences.
- Regular team off-sites and conference attendance.
- Opportunity to shape core infrastructure for frontier AI research.
- The position is available in the APAC region or the USA.
Tech Stack
Categories
Solutions Engineering
About Prime Intellect
Prime Intellect builds a full-stack platform for training frontier AI models, giving enterprises access to distributed compute and agentic training infrastructure to develop their own systems. The company operates as a platform and open research lab, with customers leveraging its infrastructure rather than building it in-house. Headquartered in San Francisco and privately held, it has raised a Series A round backed by investors including Founders Fund and NVIDIA.