Prior Labs

Infrastructure Engineer, GPU Clusters

Prior Labs
Apply
10 hours ago
Freiburg im Breisgau, Germany +2 moreMid Level

Responsibilities

  • Own and evolve multi-cluster GPU infrastructure, including cluster architecture, automated provisioning, workload scheduling, reliability, capacity planning, and cost optimization.
  • Operate and expand Slurm and SkyPilot infrastructure across GCP and future cloud providers and GPU generations.
  • Build CI/CD pipelines, automated testing, reproducible environments, experiment tracking, and internal tooling for research productivity.
  • Improve infrastructure reliability through monitoring, observability, infrastructure as code, and automation.
  • Guide compute spending decisions using cost-per-FLOP analysis across providers and hardware.
  • Work directly with researchers to make infrastructure decisions that improve training and experimentation workflows.

Requirements

  • At least 3 years of experience building and operating production infrastructure at scale, ideally involving compute clusters, distributed training systems, or HPC.
  • Hands-on experience with cluster management and workload orchestration systems such as Slurm, Kubernetes, or similar technologies.
  • Experience designing and maintaining CI/CD pipelines, automated testing, and reliable build and deployment workflows.
  • Strong systems engineering fundamentals across Linux, networking, storage, and distributed systems, with the ability to debug complex infrastructure problems.
  • Strong Python skills and sufficient training familiarity to profile data-loading, communication, and compute bottlenecks.
  • A track record of improving reliability, developer productivity, or cost efficiency through infrastructure decisions.
  • Strong familiarity with AI coding tools such as Claude Code, Cursor, or similar.
  • Bonus: familiarity with GPU infrastructure, PyTorch, GPU profiling, distributed training, multi-cloud or hybrid HPC/cloud infrastructure, multi-cluster orchestration, experiment tracking, model registries, or ML pipeline tooling.
  • Bonus: experience operating infrastructure with tens of millions in compute spending.

Benefits

  • Teams are based in Berlin, Freiburg, and New York, with exceptional remote arrangements generally requiring frequent travel to an office.
  • The company brings the whole team together regularly for offsites.
  • The company welcomes applicants from diverse backgrounds and provides equal opportunities regardless of identity or personal characteristics.
Prior Labs

About Prior Labs

51-200 employees

Prior Labs builds foundation models that understand tabular data in spreadsheets and databases for researchers and enterprises across science, healthcare, finance, and operations. The privately held company, founded in 2024 and based in Freiburg and Berlin, commercializes its models and tooling; its TabPFN v2 was a Nature cover story and is deployed with Oxford Cancer Analytics for lung disease detection and with Hitachi to help prevent train failures.

Contact me