2 months ago
San Jose, CA, USASenior
Responsibilities
- Design and develop distributed communication and execution capabilities in the Triton AMDGPU backend for scalable multi-GPU AI workloads.
- Implement compiler and runtime mechanisms for GPU-initiated communication, collective operations, remote memory access, synchronization, and distributed execution.
- Optimize compute, communication, inter-GPU data movement, communication/computation overlap, memory hierarchy utilization, and GPU-driven scheduling.
- Develop and optimize distributed Triton kernels and execution models for performance, scalability, and hardware utilization.
- Profile and debug issues across the Triton compiler, runtime, ROCm stack, and GPU hardware execution.
- Collaborate with GPU architecture, compiler, runtime, and performance teams on distributed GPU programming capabilities.
- Contribute to open-source Triton and the ROCm distributed ecosystem.
Requirements
- Deep experience in compiler development, GPU software, distributed systems, or performance engineering.
- Familiarity or hands-on experience with the Triton compiler and runtime.
- Deep understanding of GPU execution models, memory hierarchy, scheduling, occupancy, and hardware performance.
- Understanding of GPU runtime systems, communication stacks, and multi-GPU interconnects such as XGMI, NVLink, PCIe, or InfiniBand.
- Familiarity with distributed GPU communication libraries including RCCL, NCCL, NVSHMEM, rocSHMEM, or MPI.
- Experience developing, optimizing, and scaling multi-GPU workloads and inter-GPU communication.
- Strong GPU programming experience with Triton, HIP, CUDA, or similar parallel programming environments.
- Strong knowledge of MLIR and/or LLVM internals.
- Experience profiling, debugging, and optimizing across compiler, runtime, and hardware layers.
- Experience with ROCm, HIP, CUDA, and related performance profiling and optimization tools.
- Experience optimizing large-scale AI, machine learning, or HPC workloads across multi-GPU systems.
- Experience contributing to open-source projects and working in collaborative engineering environments.
- Strong problem-solving, communication, and technical leadership skills.
- Bachelor’s or Master’s degree in Computer Engineering, Computer Science, or Electrical Engineering, or equivalent practical experience.
Benefits
- AMD benefits are offered; details are provided through AMD’s benefits-at-a-glance materials.
- The role is located in San Jose, California.
- This role is not eligible for visa sponsorship.
About AMD
AMD designs and sells CPUs, GPUs, and adaptive/embedded computing products for PCs, data centers, gaming, and edge devices. Its portfolio includes Ryzen and EPYC processors, Radeon and Instinct graphics, and adaptive SoCs from its Xilinx acquisition, sold to OEMs, cloud providers, and device makers. Founded in 1969 and headquartered in Santa Clara, it is a public company on NASDAQ and supplies semi-custom chips for major game consoles.