Software Engineer, Model Inference
OpenAI
about 1 year ago
San Francisco, CA, USA
Senior
Base Salary
$295k - $555k/yr
Responsibilities
- Collaborate with machine learning researchers and engineers to deploy technologies into production.
- Enable advanced research through engineering solutions.
- Introduce techniques and tools to enhance model inference performance.
- Build tools for identifying bottlenecks and instabilities.
- Optimize code and Azure VM fleets for maximum hardware utilization.
Requirements
- At least 5 years of professional software engineering experience.
- Understanding of modern ML architectures and inference optimization.
- Familiarity with PyTorch, NVidia GPUs, and related software stacks.
- Experience with production distributed systems and performance-critical applications.
- Ability to self-direct and prioritize important problems.
Tech Stack
AzurePyTorch
Categories
AI & MLBackendData Engineering