Software Engineer (Big Data) , Recommendation Ecosystem Infrastructure (ByteDance Singapore)
ByteDanceResponsibilities
- Design and implement real-time streaming computing data systems for large-scale recommendation systems.
- Create flexible, scalable, stable, and high-performance storage systems and computing models.
- Troubleshoot production failures and implement mechanisms and tools to improve system stability.
- Build streaming computing frameworks and distributed systems for reliable infrastructure at massive scale.
- Research, design, and develop computer and network software and specialized utility programs.
- Analyze user needs and develop software solutions using computer science, engineering, and mathematical principles.
- Update existing software, enhance capabilities, and direct software testing and validation procedures.
- Collaborate with computer hardware engineers to integrate hardware and software systems and define specifications and performance requirements.
Requirements
- At least 3 years of relevant experience.
- Proficiency in Java, C++, Scala, or Python, with strong coding and troubleshooting skills.
- Deep understanding of streaming computing systems and formal production experience developing TB-level Flink real-time computing systems.
- Proficiency with Flink DataStream, Flink SQL, Flink Checkpoint, and Flink State; experience reading Flink source code is preferred.
- Preferred experience developing data lakes and familiarity with Hudi, Iceberg, or Delta Lake.
- Experience handling PB-level data is a plus.
- Familiarity with YARN, Kubernetes, Spark, Spark SQL, Kudu, and other big data systems is preferred.
- Experience with HBase, Cassandra, or RocksDB storage systems is preferred.
- Willingness to tackle ambiguous problems and learn new technologies.
Tech Stack
Categories
About ByteDance
ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.