3 hours ago
Base Salary
$180k - $440k/yr
Responsibilities
- Scale synthetic coding data to trillions of tokens with large-scale Docker verification.
- Distill flagship-model intelligence into flash models through synthetic data generation.
- Optimize mid-training data mixtures to increase the ceiling for reinforcement learning.
- Engineer long-context data recipes.
- Develop robust and diverse evaluations for mid-training checkpoints.
Requirements
- Write production-quality code in Python, PyTorch, JAX, Rust, or C++.
- Have experience training large models, including pre-training, post-training, fine-tuning, or reinforcement learning training of neural networks with 1B+ parameters.
- Be familiar with scaling laws and state-of-the-art techniques for curating AI training data across text, image, audio, and video modalities.
- Demonstrate strong ML experiment design and engineering ability with large-scale data processing frameworks.
- Preferred experience includes ML and large-model scaling, Spark, Ray, and other large-scale data processing frameworks.
Benefits
- Base salary is $180,000–$440,000 USD.
- Equity is included in the total rewards package.
- Comprehensive medical, vision, and dental coverage are provided.
- Access to a 401(k) retirement plan, short- and long-term disability insurance, life insurance, discounts, and other perks are provided.
Categories
About xAI
Understand the Universe. We are a team of AI technologists and business leaders on a mission to build AI systems that can help humanity understand the world better. https://x.ai/careers