1 day ago
Base Salary
$200k - $375k/yr
Responsibilities
- Design, build, and optimize massive GPU clusters for extreme-scale training and inference workloads.
- Develop and tune low-level CUDA kernels, including GeMM and attention kernels, using CUTLASS, Tensor Cores, and Nsight.
- Profile, debug, and eliminate bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operations.
- Collaborate with AI research teams to deliver production-grade performance and scalability.
Requirements
- At least 5 years of experience with low-level systems programming in C/C++.
- Deep low-level systems-programming experience with C, C++, PTX, or SASS.
- Strong experience with large-scale GPU clusters or distributed compute infrastructure at production scale.
- Hands-on experience with GPU kernel optimization, including CUTLASS, custom kernels, and Nsight profiling.
- A track record of building or operating high-performance infrastructure for AI training or inference workloads.
- Ability to optimize memory-bound and compute-bound workloads from first principles.
Benefits
- Equity.
- Comprehensive medical, vision, and dental coverage.
- 401(k) retirement plan.
- Short- and long-term disability insurance.
- Life insurance, discounts, and other perks.
About xAI
Understand the Universe. We are a team of AI technologists and business leaders on a mission to build AI systems that can help humanity understand the world better. https://x.ai/careers