AI Platform Engineer (m/f/x)
Scalable Capital GmbH5 hours ago
Munich, GermanySenior
Responsibilities
- Develop and maintain an internal AI provisioning platform that provides access to LLMs and MCP Servers.
- Implement LLM observability, logging, and alerting using tools such as Datadog and Langfuse.
- Enforce model governance covering security, data privacy, rate limiting, and LLM API cost management.
- Collaborate with AI Software Engineers on cloud-native architectures and agentic workflow integrations.
- Build and maintain infrastructure for monitoring the reliability and performance of production AI systems.
Requirements
- Bachelor’s or master’s degree in Computer Science, Software Engineering, or a related field.
- Several years of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
- Strong experience with cloud infrastructure, preferably AWS, and Infrastructure as Code using Terraform.
- Proficiency in at least one programming language such as Python or Go.
- Experience with CI/CD pipelines and containerization such as Docker.
- Understanding of API cost management, rate limiting, security best practices, and data privacy for AI models.
- Experience with or willingness to learn LLM gateways, observability platforms, and telemetry such as LiteLLM, Langfuse, and Datadog.
- Strong problem-solving skills and ability to work as an embedded platform expert in a cross-functional Data Science and AI team.
Benefits
- International, diverse, inclusive team with opportunities for learning and career development.
- Latest hardware and tools, in-house knowledge sharing, career development sessions, and an individual Education Budget.
- Free German language classes and international relocation support if required.
- Opportunity to work from abroad.
- Attractive compensation package and company pension scheme.
- Monthly contribution covering 50% of the Deutschland Jobticket.
- Complimentary Scalable Capital PRIME+ Broker subscription with no order commissions.
- Flexible and discounted sports activities through Urban Sports Club.