ByteDance

Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling)

ByteDance
Apply
6 hours ago
San Jose, CA, USASenior
H1B sponsor

Responsibilities

  • Enhance Kubernetes-based cluster platforms for performance, scalability, resilience, and global resource management.
  • Design and maintain unified scheduling for containers, VMs, online services, offline computing, AI/ML, and CPU/GPU workloads.
  • Develop intelligent scheduling systems that optimize workload performance and resource utilization across heterogeneous resources and global data centers.
  • Design and drive compute platforms for fast, reliable, and cost-effective ML and LLM training and inference.
  • Write high-quality maintainable code and advance open-source and research-oriented infrastructure in AI, ML, systems, and serverless technologies.

Requirements

  • Bachelor’s or master’s degree in computer science, computer engineering, or a related area.
  • At least 3 years of relevant industry experience; new graduates with a Ph.D. and strong publication records may be considered as an exception.
  • Understanding of Unix/Linux environments, distributed and parallel systems, high-performance networking systems, or large-scale software development.
  • Experience designing, architecting, and building cloud and ML infrastructure, including resource management, allocation, job scheduling, and monitoring.
  • Familiarity with Docker and Kubernetes.
  • Proficiency in at least one major programming language such as Python, Go, C++, Rust, or Java.
  • Experience with a large-scale cluster management system such as Kubernetes, Ray, Yarn, or Mesos.
  • Experience with large-scale resource efficiency management, job scheduling, application scaling, workload co-location, or isolation enhancement.
  • Experience with AWS, Azure, or GCP and their ML services such as AWS SageMaker, Azure ML, or GCP Vertex AI.
  • Strong communication skills and ability to work across engineering teams.
ByteDance

About ByteDance

10,000+ employees

ByteDance is a global incubator of platforms at the cutting edge of commerce, content, entertainment and enterprise services - over 2.5bn people interact with ByteDance products including TikTok. Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. We are committed to building a safe, healthy and positive online environment for all our users. We have over 110,000 employees based in more than 30 countries globally. Join us.

Contact me