Machine Learning Performance Engineer
Jane Streetabout 3 hours ago
Responsibilities
- Optimize performance of machine learning models for training and inference.
- Enhance large-scale training efficiency and low-latency inference in real-time systems.
- Implement a whole-systems approach to performance, considering storage and networking.
- Debug training run performance end-to-end using various tools.
- Ensure optimal throughput and goodput at the lowest system levels.
Requirements
- Experience in low-level systems programming and optimization.
- Understanding of modern machine learning techniques and toolsets.
- Low-level GPU knowledge including PTX, SASS, and memory hierarchy.
- Experience with debugging and optimization tools like CUDA GDB and NSight.
- Familiarity with libraries such as Triton, cuDNN, and cuBLAS.
- Background in networking technologies like Infiniband and NVLink.
Tech Stack
Sass
Categories
AI & MLData Engineering