Data Engineer Graduate(TikTok Recommendation Ecosystem Architecture, Singapore) - 2027 Start (PhD)
ByteDanceResponsibilities
- Design and implement real-time and offline data architecture for large-scale recommendation systems.
- Build scalable, high-performance streaming Lakehouse systems for feature pipelines, model training, and real-time inference.
- Collaborate with ML platform teams on PyTorch-based model training workflows and efficient data formats and access patterns.
- Own distributed storage and processing components including file formats, stream compaction, and metadata management.
- Optimize data lakes, caching, distributed computing, and GPU I/O to reduce foundation-model training and inference costs and improve iteration efficiency.
Requirements
- Be completing or have recently completed a PhD in Artificial Intelligence, Software Development, Computer Science, Computer Engineering, or a related discipline.
- Have experience building large-scale distributed systems, preferably in storage, stream processing, or ML infrastructure.
- Understand Apache Flink internals, with hands-on experience in state management, connectors, or UDFs.
- Be familiar with modern Lakehouse technologies such as Apache Paimon, Iceberg, Delta Lake, or Hudi, including incremental ingestion, schema evolution, and snapshot isolation.
- Preferably have experience designing and optimizing Flink and Paimon architectures for unified batch and stream processing.
- Preferably have familiarity with feature storage and training-data pipelines integrated with PyTorch.
- Preferably understand columnar formats such as Parquet, ORC, and Lance for feature engineering or ML data loading.
- Preferably be proficient in Java, Scala, or C++ and have strong debugging and performance-tuning ability.
- Preferably have experience with Lakehouse metadata management, compaction scheduling, data versioning, or legacy data stores such as HBase and Kudu.
Benefits
- Graduate opportunity with opportunities to pursue bold ideas, tackle complex challenges, and grow within the TikTok Recommendation Ecosystem Architecture team.
- Singapore role with an onboarding date commitment by the end of the year; candidates must state availability and graduation date in their resume.
- 2027 start role.
About ByteDance
ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.