TPU Kernel Engineer
Anthropic
9 months ago
New York, NY, USA +2 more
Mid Level / Senior
H1B Sponsor
Base Salary
$315k - $560k/yr
Responsibilities
- Identify and address performance issues in ML systems.
- Design and optimize kernels for TPUs.
- Provide feedback to researchers on model changes and performance.
- Implement low-latency, high-throughput sampling for large language models.
- Adapt models for low-precision inference.
- Build quantitative models of system performance.
- Design and implement custom collective communication algorithms.
- Debug kernel performance at the assembly level.
Requirements
- Significant experience optimizing ML systems for TPUs, GPUs, or other accelerators.
- Results-oriented with a focus on flexibility and impact.
- Willingness to take on tasks outside of the job description.
- Enjoyment of pair programming.
- Desire to learn more about machine learning research.
- Concern for the societal impacts of work.
- Experience with high performance, large-scale ML systems is a plus.
- Understanding of computer architecture and ML framework internals is preferred.
Benefits
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Collaborative office space.
Categories
AI & MLData Engineering