Member of Technical Staff (Software Engineer, Inference & Training Platform)
Perplexityabout 4 hours ago
Remote, United States +4 moreMid Level / Senior / Staff+
H1B Sponsor
Base Salary
$250k - $485k/yr
Responsibilities
- Build a self-serve compute platform for training and inference workloads.
- Operate and manage the GPU fleet, ensuring reliability and capacity integration.
- Develop scheduling and placement logic for efficient resource utilization.
- Support both long-running training jobs and production inference services.
- Manage Kubernetes orchestration for GPU resources across multiple providers.
- Implement fault tolerance, autoscaling, and observability for the GPU fleet.
Requirements
- Deep experience with Kubernetes, including custom operators and multi-cluster federation.
- Experience managing GPU clusters at scale, particularly with NVIDIA hardware and CUDA.
- Knowledge of orchestrating compute across multiple cloud providers like AWS and GCP.
- Strong fundamentals in distributed systems, including scheduling and fault tolerance.
- Proficiency in infrastructure and systems-level programming in Go, Rust, or C++.
- Experience supporting both training jobs and high-availability inference services.