6 hours ago
San Jose, CA, USASenior
Base Salary
$212k - $318k/yr
Responsibilities
- Design and develop native distributed communication and execution capabilities within the Triton AMDGPU backend.
- Implement compiler and runtime mechanisms for GPU-initiated communication, collective operations, remote memory access, synchronization, and distributed execution.
- Optimize compute, communication, inter-GPU data movement, communication/computation overlap, memory hierarchy utilization, and GPU-driven scheduling.
- Develop and optimize distributed Triton kernels and execution models for scalable AI workloads.
- Analyze, profile, and debug issues spanning the Triton compiler, runtime, ROCm stack, and GPU hardware.
- Collaborate with GPU architecture, compiler, runtime, and performance teams on distributed GPU programming capabilities.
- Contribute to open-source Triton and the ROCm distributed ecosystem.
Requirements
- Deep experience in compiler development, GPU software, distributed systems, or performance engineering.
- Familiarity or hands-on experience with the Triton compiler and runtime.
- Understanding of GPU execution models, memory hierarchy including LDS, L2, and HBM, scheduling, occupancy, and hardware performance.
- Understanding of GPU runtime systems, communication stacks, and multi-GPU interconnects including XGMI, NVLink, PCIe, and InfiniBand.
- Experience with distributed GPU communication libraries such as RCCL, NCCL, NVSHMEM, rocSHMEM, or MPI.
- Experience developing, optimizing, and scaling workloads across multiple GPUs.
- Strong GPU programming experience using Triton, HIP, CUDA, or similar parallel programming environments.
- Strong knowledge of MLIR and/or LLVM internals.
- Experience profiling, debugging, and optimizing across compiler, runtime, and hardware layers.
- Familiarity with ROCm, HIP, CUDA, and GPU performance profiling and optimization tools.
- Experience optimizing large-scale AI, machine learning, or HPC workloads across multi-GPU systems.
- Experience contributing to open-source projects and working in collaborative engineering environments.
- Bachelor’s or Master’s degree in Computer Engineering, Computer Science, or Electrical Engineering, or equivalent practical experience.
Benefits
- Benefits are described through AMD benefits at a glance.
- This role is located in San Jose, California.
- This role is not eligible for visa sponsorship.
Tech Stack
Categories
About AMD
AMD designs and sells CPUs, GPUs, and adaptive/embedded computing products for PCs, data centers, gaming, and edge devices. Its portfolio includes Ryzen and EPYC processors, Radeon and Instinct graphics, and adaptive SoCs from its Xilinx acquisition, sold to OEMs, cloud providers, and device makers. Founded in 1969 and headquartered in Santa Clara, it is a public company on NASDAQ and supplies semi-custom chips for major game consoles.