20 hours ago
San Jose, CA, USAStaff+
Base Salary
$240k - $360k/yr
Responsibilities
- Define goals, scope, and roadmap for AMD collectives and network optimization initiatives.
- Design and develop collective communication algorithms and libraries, including all-reduce, all-to-all, and all-gather, across scale-up and scale-out networks.
- Tune, profile, and analyze large-scale LLM, diffusion, multimodal, RecSys, and generative AI training and inference workloads.
- Participate in co-design of future scale-up networks, NICs, and scale-out networks, representing software performance requirements to hardware teams.
- Develop performance estimation, modeling, regression-tracking, and reporting frameworks, tools, and infrastructure.
- Collaborate with GPU library, compiler, runtime, framework, and open-source teams to integrate optimizations upstream.
- Provide guidance on network load balancing, workload scheduling, and model sharding strategies.
- Present performance analysis and modeling results with recommendations to stakeholders and senior leadership.
- Apply software engineering practices and establish standards for robust, maintainable solutions.
- Provide technical leadership, mentorship, code reviews, and guidance to junior team members.
Requirements
- Principal-level expertise in collective communication libraries and network performance, including RCCL, NCCL, or MPI.
- Deep understanding of NIC, RDMA, scale-up, and scale-out network architectures and their effects on model performance.
- Proven experience with performance analysis, projection, bottleneck identification, and optimization across model, software, and hardware layers.
- Experience integrating optimized communication into PyTorch, JAX, vLLM, and SGLang for scalable training and inference.
- Advanced proficiency in C++ and Python, including performance tuning, debugging, and robust test design.
- Broad experience optimizing AI workloads in large-scale heterogeneous compute environments and clusters.
- Demonstrated ability to lead cross-team initiatives, mentor engineers, and communicate effectively in writing and presentations.
- Senior industry experience in technical software development focused on performance engineering, communication libraries, networking, and GPU or distributed systems.
- Master’s and/or PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
Benefits
- AMD benefits are offered as described in its benefits-at-a-glance materials.
- The position is onsite in San Jose, California or Austin, Texas.
About AMD
AMD designs and sells CPUs, GPUs, and adaptive/embedded computing products for PCs, data centers, gaming, and edge devices. Its portfolio includes Ryzen and EPYC processors, Radeon and Instinct graphics, and adaptive SoCs from its Xilinx acquisition, sold to OEMs, cloud providers, and device makers. Founded in 1969 and headquartered in Santa Clara, it is a public company on NASDAQ and supplies semi-custom chips for major game consoles.