AMD

Software Development Engineer - AI Workload Optimization

AMD
Apply
21 hours ago

Base Salary

$212k - $318k/yr

Responsibilities

  • Set the technical vision and roadmap for AI workload optimization across AMD’s software stack.
  • Profile, analyze, and tune large-scale LLM, diffusion, multimodal, and MoE workloads on AMD hardware.
  • Partner with customers and hyperscalers to deliver tailored architectural improvements and software optimizations.
  • Collaborate with hardware architecture, compiler, and framework teams on hardware-software co-design.
  • Drive tools and frameworks for performance estimation, modeling, and automated reporting.
  • Represent AMD in industry forums and open-source communities while mentoring engineers and technical leaders.

Requirements

  • Deep software development experience with a high-level technical leadership track record, such as Fellow or equivalent.
  • Deep expertise in PyTorch, JAX, vLLM, SGLang, and the ROCm software stack.
  • Experience optimizing distributed inference and training at scale across multi-node and multi-GPU environments.
  • Mastery of performance profiling tools such as TorchProfiler, ROCm Profiler, and Nsight, plus hardware-level performance modeling.
  • Strong understanding of Transformer, Attention, and KV Cache architectures and techniques including quantization, speculative decoding, and FlashAttention.
  • Demonstrated research or applied AI/ML experience in deep learning, model training or inference optimization, large language models, or computer vision.
  • Master’s degree or bachelor’s degree in computer science, electrical engineering, or a related field, or equivalent experience.
  • Ability to drive cross-functional initiatives in fast-paced, ambiguous environments.

Tech Stack

Categories

AMD

About AMD

10,000+ employees

AMD designs and sells CPUs, GPUs, and adaptive/embedded computing products for PCs, data centers, gaming, and edge devices. Its portfolio includes Ryzen and EPYC processors, Radeon and Instinct graphics, and adaptive SoCs from its Xilinx acquisition, sold to OEMs, cloud providers, and device makers. Founded in 1969 and headquartered in Santa Clara, it is a public company on NASDAQ and supplies semi-custom chips for major game consoles.

Contact me