Prior Labs

Backend Software Engineer, ML Inference

Prior Labs
Apply
10 hours ago
Freiburg im Breisgau, Germany +2 moreMid Level

Responsibilities

  • Own the model serving path across managed APIs, customer VPCs, and self-hosted open-weight deployments, optimizing latency, throughput, batching, memory behavior, and cost per prediction.
  • Design robust, scalable, and secure backend systems and production-grade APIs for foundation model serving.
  • Develop maintainable code for core backend services.
  • Design, deploy, and manage cloud infrastructure with a focus on reliability, monitoring, observability, and cost efficiency.
  • Implement GDPR-compliant data storage, access controls, usage tracking, quota management, and other security measures.
  • Drive engineering standards for testing, CI/CD, documentation, and security.
  • Work directly with AI researchers to translate cutting-edge models into scalable production systems.

Requirements

  • 3+ years of professional experience in machine learning and backend engineering, including production infrastructure ownership.
  • Experience deploying and operating machine learning models in production and understanding their behavior under real traffic.
  • Strong hands-on experience designing and building production-grade APIs and backend services.
  • Significant experience building and operating services on cloud platforms, preferably GCP.
  • Strong hands-on experience with Infrastructure as Code using tools such as Terraform.
  • Significant experience with Docker and Kubernetes.
  • Proficiency in Python.
  • Experience with ML infrastructure, MLOps, model serving frameworks, feature stores, or data pipelines is a differentiator.
  • Deep experience with inference optimization techniques such as quantization, compilation, dynamic batching, caching strategies, and distributed computing is a differentiator.
  • Experience with PyTorch and FastAPI, relevant open-source contributions, and related production experience are preferred.

Benefits

  • Teams are based in Berlin, Freiburg, and New York, with exceptional remote arrangements generally involving frequent travel to an office.
  • The company regularly holds company-wide offsites.
  • The role offers significant autonomy, architectural ownership, and opportunities to specialize or grow into technical leadership.
  • Prior Labs provides equal opportunity and welcomes applicants from varied identities and backgrounds.
Prior Labs

About Prior Labs

51-200 employees

Prior Labs builds foundation models that understand tabular data in spreadsheets and databases for researchers and enterprises across science, healthcare, finance, and operations. The privately held company, founded in 2024 and based in Freiburg and Berlin, commercializes its models and tooling; its TabPFN v2 was a Nature cover story and is deployed with Oxford Cancer Analytics for lung disease detection and with Hitachi to help prevent train failures.

Contact me