1 year ago
Palo Alto, CA, USASenior / Staff+
Responsibilities
- Design APIs that abstract complex GPU operations into developer-friendly experiences.
- Build scheduling algorithms and resource management systems for GPU provisioning, allocation, scheduling, and release.
- Create usage tracking and billing systems for GPU-hours, memory usage, and compute utilization.
- Implement GPU monitoring, health checks, automatic failure recovery, multi-tenancy, quotas, resource isolation, and fair scheduling.
- Optimize model-serving cold starts and model-loading strategies.
- Collaborate with frontend engineers and use AI-assisted coding tools to improve productivity and code quality.
Requirements
- 5+ years of backend engineering experience with distributed systems.
- Strong proficiency in Go, Python, or similar backend languages.
- Experience with resource scheduling, orchestration, and API design using REST, GraphQL, or gRPC.
- Understanding of hardware constraints, system optimization, Linux systems, and containerization with Docker and Kubernetes.
- Ability to work with expensive compute resources where efficiency affects costs.
- GPU or HPC cluster management experience is preferred.
- Understanding of ML/AI workload patterns, high-value resource allocation, compute-intensive performance optimization, GPU virtualization and sharing, or billing and metering systems is preferred.
Benefits
- Competitive salary and equity based on experience and skillset.
- Hybrid work arrangement with 3 days in the office and 2 days working from home; applicants must be located in Palo Alto.
About Zettabyte
Zettabyte builds Zetta-ERP, a SaaS and white‑label platform for private universities that manages the student and academic lifecycle end to end. It also develops software to deploy, manage, and optimize large‑scale GPU clusters for enterprises and governments, working with hardware supply-chain partners like Foxconn, Wistron, and Pegatron. Founded in 2016 and headquartered in Singapore, the company is privately held and serves higher‑education institutions globally.