Responsibilities
- Develop the Volcano Ark training platform for serverless supervised fine-tuning and reinforcement learning workflows.
- Design elastic, multi-tenant training systems across data centers and heterogeneous hardware while optimizing throughput, resource utilization, and stability.
- Build reinforcement learning infrastructure and developer-friendly APIs for large-scale training.
- Develop and optimize the Volcano Ark Model-as-a-Service inference platform across heterogeneous GPU clusters.
- Reduce inference costs through disaggregated inference, distributed KV caches, heterogeneous inference, elastic scheduling, and multi-tenant co-location.
Requirements
- Be completing or have recently completed a bachelor’s or master’s degree in computing or a related discipline.
- Be proficient in one or more of Python, Rust, or C++ and demonstrate strong coding, software design, and framework architecture skills.
- Have hands-on experience designing training frameworks or optimizing large-scale training systems; LLM infrastructure or complex distributed-systems experience is highly preferred.
- Understand GPU architectures and high-performance computing software stacks such as CUDA; GPU profiling and optimization experience is preferred.
- Have strong systems-architecture and heterogeneous-computing knowledge; Kubernetes, Ray, reinforcement learning frameworks, LLM inference optimization, distributed communication, and RDMA experience are preferred.
Benefits
- Graduate opportunity with a 2027 start and onboarding availability required by the end of 2027.
- Applications are reviewed on a rolling basis, and candidates may apply to a maximum of two ByteDance or affiliate positions globally.
Tech Stack
Categories
About ByteDance
ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.