AMD

GPU Kernel Engineer

AMD
Apply
1 day ago
Santa Clara, CA, USASenior
H1B sponsor

Base Salary

$146k - $218k/yr

Responsibilities

  • Optimize TensorFlow, PyTorch, and SGLang performance on AMD GPUs through upstream open-source contributions.
  • Design, implement, debug, profile, and optimize high-performance GPU kernels using HIP, Triton, or related tools.
  • Tune large-scale deep learning training and inference models for AMD hardware.
  • Optimize multi-GPU and multi-node workloads, including inference parallelism and collective communication strategies.
  • Collaborate with GPU library and compiler teams to integrate kernel-level optimizations with full-stack performance goals.
  • Support SGLang optimization, feature development, and scaling across AMD GPU platforms.
  • Work with external maintainers to propose and upstream framework optimizations.
  • Apply software engineering practices including profiling, test-driven development, debugging, and CI integration.

Requirements

  • Proficiency in C++ and/or Python with experience debugging, profiling, and optimizing performance-critical code.
  • Strong Linux development experience and software engineering problem-solving skills.
  • Hands-on SGLang or similar LLM inference framework experience is highly preferred.
  • Background in compiler design or familiarity with LLVM, MLIR, or ROCm is a plus.
  • Experience scaling distributed training or inference workloads on large heterogeneous CPU and GPU clusters is preferred.
  • Experience integrating optimizations into deep learning frameworks such as PyTorch or TensorFlow is preferred.
  • Working knowledge of HIP, CUDA, or other GPU programming models is preferred; GCN or CDNA architecture experience is a plus.
  • Bachelor’s degree or working toward a master’s degree in computer science, computer engineering, electrical engineering, or a related field.

Benefits

  • AMD benefits are described in the company’s benefits overview.
  • The posting states that AMD is an equal opportunity and inclusive employer and will accommodate applicants’ needs under applicable laws.

Tech Stack

Categories

AMD

About AMD

10,000+ employees

AMD designs and sells CPUs, GPUs, and adaptive/embedded computing products for PCs, data centers, gaming, and edge devices. Its portfolio includes Ryzen and EPYC processors, Radeon and Instinct graphics, and adaptive SoCs from its Xilinx acquisition, sold to OEMs, cloud providers, and device makers. Founded in 1969 and headquartered in Santa Clara, it is a public company on NASDAQ and supplies semi-custom chips for major game consoles.

Contact me