Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Perplexity11 days ago
Base Salary
$250k - $485k/yr
Responsibilities
- Build and own a self-serve compute platform for launching training jobs and operating inference services.
- Provision, manage, and integrate GPU capacity across multiple cloud providers.
- Develop scheduling and placement logic to efficiently allocate scarce GPU capacity.
- Support long-running distributed training workloads and highly available, low-latency inference services.
- Write Kubernetes operators and CRDs and manage multi-cluster GPU orchestration across providers.
- Build fault tolerance, autoscaling, and observability so workloads survive infrastructure and capacity failures.
- Set platform architecture and roadmap in partnership with inference and cloud infrastructure teams.
Requirements
- Deep Kubernetes experience, including custom operators, CRDs, and multi-cluster federation.
- Experience managing GPU clusters at scale with NVIDIA hardware, CUDA, and InfiniBand or RoCE networking.
- Experience orchestrating compute across multiple clouds such as CoreWeave, AWS, and GCP.
- Strong distributed systems fundamentals in scheduling, resource allocation, and fault tolerance under load.
- Systems-level programming experience in Go, Rust, or C++.
- Experience supporting both long-running training jobs and high-availability inference services.
- Ability to own problems end-to-end in an ambiguous environment.
- Preferred experience with vLLM, SGLang, TensorRT-LLM, Slurm, GPU kernels in CUDA or Triton, RDMA, and ML observability tools such as Prometheus, Grafana, or Weights & Biases.
Tech Stack
Categories
About Perplexity
Perplexity builds an AI-powered answer engine for web and mobile and an enterprise product, Perplexity Computer, for AI-driven workflows across tools and apps. The company monetizes through individual subscriptions (Perplexity Pro) and enterprise plans. Founded in 2022 and headquartered in San Francisco, it operates as a privately held company.