Machine Learning Performance Engineer
Jane Street1 month ago
Responsibilities
- Optimize machine learning model training and inference performance.
- Improve efficient large-scale training, low-latency real-time inference, and high-throughput research inference.
- Develop and optimize CUDA implementations using a whole-systems approach across storage, networking, host systems, and GPUs.
- Investigate throughput, goodput, cache behavior, latency, and other low-level performance characteristics.
- Support and optimize networking technologies and collective algorithms for distributed GPU clusters.
Requirements
- Understanding of modern machine learning techniques and toolsets.
- Experience and systems knowledge to debug training-run performance end to end.
- Low-level GPU knowledge including PTX, SASS, warps, cooperative groups, Tensor Cores, and memory hierarchy.
- Debugging and optimization experience with CUDA GDB, Nsight Systems, and Nsight Compute.
- Knowledge of Triton, CUTLASS, CUB, Thrust, cuDNN, and cuBLAS.
- Understanding of CUDA graph launch, tensor core arithmetic, warp-level synchronization, and asynchronous memory loads.
- Background in InfiniBand, RoCE, GPUDirect, PXN, rail optimization, and NVLink for connecting GPU clusters.
- Understanding of collective algorithms for distributed GPU training in NCCL or MPI.
- Inventive approach and willingness to question existing approaches and tools.
- Fluency in English.
Tech Stack
Sass
Categories
About Jane Street
Jane Street is a quantitative trading firm with offices in New York, London, Hong Kong, Singapore, and Amsterdam. We are always recruiting top candidates and we invest heavily in teaching and training. The environment at Jane Street is open, informal, intellectual, and fun. People grow into long careers here because there are always new and interesting problems to solve, systems to build, and theories to test. More than twenty years after our founding, it still feels like we’re just getting started. Jane Street does not offer any services to individual investors: https://www.janestreet.com/fraud-and-impersonation-warnings/