Responsibilities
- Design and implement real-time streaming data systems for large-scale recommendation systems.
- Create flexible, scalable, stable, and high-performance storage systems and computing models.
- Troubleshoot production failures and implement mechanisms and tools to improve system stability.
- Build streaming computing frameworks and distributed systems for massive data and large-scale business systems.
- Research, design, and develop computer, network, and specialized utility software.
- Analyze user needs and develop software solutions using computer science, engineering, and mathematical principles.
- Update software, enhance existing capabilities, and develop and direct software testing and validation procedures.
- Work with computer hardware engineers to integrate hardware and software systems and define specifications and performance requirements.
Requirements
- Proficiency in Java, C++, Scala, and Python programming languages.
- Strong coding and troubleshooting skills.
- At least 5 years of relevant experience.
- Deep understanding of streaming computing systems and formal production experience developing TB-level Flink real-time computing systems.
- Experience with FlinkDataStream, FlinkSQL, FlinkCheckpoint, and FlinkState, preferably including Flink source-code reading.
- Familiarity with at least one data lake technology, such as Hudi, Iceberg, or Delta Lake, preferably including source-code reading.
- Experience handling PB-level data is preferred.
- Familiarity with YARN, Kubernetes, Spark, Spark SQL, Kudu, and other big data systems is preferred.
- Experience with storage systems such as HBase, Cassandra, and RocksDB is preferred.
- Experience in data lake development is preferred.
- Willingness to tackle ambiguous problems and learn new technologies.
Tech Stack
Categories
About ByteDance
ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.