Responsibilities
- Design, develop, and optimize large-scale data ingestion systems for real-time pipelines with high throughput, low latency, and fault tolerance.
- Improve the performance, scalability, and reliability of data ingestion pipelines.
- Develop automated and intelligent operations and maintenance systems for monitoring, diagnosis, stability, and reliability.
- Collaborate with cross-functional teams to deliver event data ingestion, transformation, and storage solutions.
- Troubleshoot and resolve complex production issues while minimizing downtime and optimizing performance.
Requirements
- Bachelor's degree in Computer Science or equivalent practical experience.
- At least 2 years of software development experience with proficiency in one or more programming languages, such as Java, Scala, Python, or Go.
- Strong understanding of data structures, algorithms, and distributed systems principles.
- Hands-on experience with big data technologies such as Hadoop, Flink, Kafka, or similar frameworks.
- Preferred: at least 2 years of experience with real-time data processing frameworks such as Flink.
- Preferred: experience in event tracking, including event collection, real-time processing, governance, quality assurance, and cost optimization.
- Preferred: deep understanding of data lakehouse architectures and stream-batch processing integration.
- Contributions to open-source projects are a plus.
Tech Stack
Categories
About ByteDance
ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.