AMD

Fellow Software Development Engineer, GEMM Optimization

AMD
Apply
2 months ago
San Jose, CA, USAStaff+
H1B sponsor

Responsibilities

  • Analyze AMD GPU hardware specifications and collaborate with hardware architects on current and future GPU designs.
  • Develop support for new ISA and hardware/software optimization features in the tensile-lite code generator.
  • Innovate and implement algorithms for GEMM and GEMM + X, including attention workloads.
  • Profile GEMM performance across the stack and identify root causes of bottlenecks.
  • Work with customers and internal stakeholders to reproduce performance issues and deliver targeted optimizations.

Requirements

  • Strong command of GPU computer architecture, including compute units, register files, cache and LDS hierarchies, memory bandwidth, matrix-core or WMMA-style instructions, and instruction scheduling.
  • Deep expertise in GEMM algorithms and their mapping to GPU hardware, including tiling, blocking, register/LDS allocation, wave scheduling, and memory hierarchy utilization.
  • Strong software engineering fundamentals and a record of building production-quality, high-performance software.
  • Demonstrated experience optimizing GPU compute kernels, ideally GEMM and attention workloads.
  • Proficiency in C++ and assembly-level GPU programming, with working knowledge of Python for tooling and automation.
  • Understanding of parallel computing, memory hierarchies, and hardware/software performance tradeoffs.
  • Clear written and verbal communication skills and the ability to collaborate with architects, customers, and cross-functional engineering teams.
  • Direct experience with a GPU compiler backend.
  • Experience with AMD CDNA or RDNA architectures, or comparable architectures such as NVIDIA Hopper or Blackwell.
  • Contributions to industry standards, publications, or patents related to GPU compute or matrix-multiply optimization.
  • BS, MS, or PhD in computer science, computer engineering, or a related field with deep relevant experience.

Benefits

  • The position is located in San Jose, California.
  • AMD benefits are offered and described in the company’s benefits overview.

Tech Stack

AssemblyC++Python

Categories

AMD

About AMD

10,000+ employees

AMD designs and sells CPUs, GPUs, and adaptive/embedded computing products for PCs, data centers, gaming, and edge devices. Its portfolio includes Ryzen and EPYC processors, Radeon and Instinct graphics, and adaptive SoCs from its Xilinx acquisition, sold to OEMs, cloud providers, and device makers. Founded in 1969 and headquartered in Santa Clara, it is a public company on NASDAQ and supplies semi-custom chips for major game consoles.

Contact me