3 months ago
San Francisco, CA, USA or New York, NY, USASenior / Staff+
H1B Sponsor
Base Salary
$150k - $350k/yr
Responsibilities
- Optimize machine learning systems for performance at scale.
- Contribute to Modal's container runtime and open-source projects.
- Enhance throughput and reduce latency for language and diffusion models.
- Debug and resolve performance issues related to GPU utilization.
- Collaborate with a team of experienced engineers and researchers.
Requirements
- 5+ years of experience writing high-quality, high-performance code.
- Experience with torch and high-level ML frameworks.
- Familiarity with Nvidia GPU architecture and CUDA.
- Experience in ML performance engineering and debugging GPU performance issues.
- Nice-to-have: familiarity with low-level operating system foundations.