Large Language Model Training System Engineer Graduate (Applied Machine Learning) - 2027 Start
ByteDanceResponsibilities
- Develop the Volcano Ark training system for serverless large model post-training, including SFT and RL.
- Design elastic training solutions for complex multi-tenant workloads spanning multiple data centers and heterogeneous hardware.
- Improve training throughput, stability, and efficiency through system optimization.
- Design reinforcement learning systems and user-friendly reinforcement learning training interfaces.
Requirements
- Be completing or have recently completed a bachelor’s or master’s degree in computer science or a related discipline.
- Be proficient in one or more of Python, Rust, or C++ and demonstrate clean coding, framework design, and abstraction skills.
- Have experience with training framework design or training system optimization; large model training engineering or complex distributed systems experience is preferred.
- Demonstrate interest in low-level principles, performance bottlenecks, technical problem solving, and scientific modeling.
- Preferred qualifications include computer architecture optimization, heterogeneous hardware, high-performance networking, scientific optimization, and familiarity with reinforcement learning and training frameworks.
Categories
About ByteDance
ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.