Software Engineer, Accelerators
OpenAI
8 months ago
San Francisco, CA, USA
Mid Level / Senior
Base Salary
$295k - $380k/yr
Responsibilities
- Prototype OpenAI's AI software stack on new accelerator platforms.
- Optimize performance of large-scale models for diverse hardware environments.
- Develop kernels and scaling strategies tailored to emerging accelerators.
- Collaborate on optimizations at the model code level to enhance performance.
- Perform system-level performance modeling and debug bottlenecks.
- Work with hardware teams to evaluate and adapt software for new architectures.
- Contribute to runtime improvements and scaling efforts for AI workloads.
Requirements
- 3+ years of experience in AI infrastructure, including kernels and systems.
- Hands-on experience with AI accelerator platforms at data center scale.
- Strong understanding of kernels, sharding, and distributed scaling techniques.
- Familiarity with optimizing LLMs, CNNs, or recommender models.
- Experience with performance modeling and system debugging.
- Ability to operate across multiple levels of the stack and prototype solutions.
- Interest in exploring alternatives to mainstream AI accelerators.
Tech Stack
PyTorch
Categories
AI & MLBackendData Engineering