AI Platform Engineer (m/f/x)

2 hours ago

Berlin, GermanySenior

Responsibilities

Develop and maintain an internal AI provisioning platform that provides access to LLMs and MCP Servers.
Implement LLM observability, logging, and alerting with tools such as Datadog and Langfuse.
Enforce model governance, security, data privacy, rate limiting, and LLM API cost management.
Collaborate with AI Software Engineers on cloud-native architectures and agentic workflow integrations.
Build and maintain infrastructure that monitors the reliability and performance of production AI systems.

Bachelor’s or master’s degree in Computer Science, Software Engineering, or a related field.
Several years of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
Strong experience with cloud infrastructure, preferably AWS, and Infrastructure as Code using Terraform.
Proficiency in at least one programming language such as Python or Go.
Experience with CI/CD pipelines and containerization such as Docker.
Understanding of API cost management, rate limiting, security best practices, and data privacy for AI models.
Experience with or willingness to learn LLM gateways, observability platforms, and telemetry such as LiteLLM, Langfuse, and Datadog.
Strong problem-solving skills and ability to work as an embedded platform expert in a cross-functional Data Science and AI team.

International, diverse, inclusive, and growing team.
Latest hardware and tools.
In-house knowledge sharing and career development sessions plus an individual Education Budget.
Free German language classes.
International relocation support when required.
Opportunity to work from abroad.
Attractive compensation package and company pension scheme.
Monthly contribution of 50% toward the Deutschland Jobticket.
Complimentary Scalable Capital PRIME+ Broker subscription with no order commissions.
Flexible and discounted sports activities through Urban Sports Club.

501-1,000 employees