OpenAI

Software Engineer, Accelerators

OpenAI

Apply
8 months ago
San Francisco, CA, USA
Mid Level / Senior

Base Salary

$295k - $380k/yr

Responsibilities

  • Prototype OpenAI's AI software stack on new accelerator platforms.
  • Optimize performance of large-scale models for diverse hardware environments.
  • Develop kernels and scaling strategies tailored to emerging accelerators.
  • Collaborate on optimizations at the model code level to enhance performance.
  • Perform system-level performance modeling and debug bottlenecks.
  • Work with hardware teams to evaluate and adapt software for new architectures.
  • Contribute to runtime improvements and scaling efforts for AI workloads.

Requirements

  • 3+ years of experience in AI infrastructure, including kernels and systems.
  • Hands-on experience with AI accelerator platforms at data center scale.
  • Strong understanding of kernels, sharding, and distributed scaling techniques.
  • Familiarity with optimizing LLMs, CNNs, or recommender models.
  • Experience with performance modeling and system debugging.
  • Ability to operate across multiple levels of the stack and prototype solutions.
  • Interest in exploring alternatives to mainstream AI accelerators.

Tech Stack

PyTorch

Categories

AI & MLBackendData Engineering