AI Platform Engineer
Qualifyze GmbH23 days ago
Remote, GermanyMid Level
Responsibilities
- Design, develop, and deploy production-ready LLM applications, including RAG pipelines, agents, and workflow automation.
- Evaluate models, frameworks, and providers for different AI use cases.
- Create evaluation processes and benchmarks for AI quality, reliability, and regressions.
- Design and manage cloud infrastructure for AI workloads.
- Build and maintain CI/CD pipelines for models, prompts, and AI services, including testing, releases, and rollbacks.
- Deploy and scale AI services with containers and orchestration tools.
- Implement monitoring and observability covering tracing, latency, output quality, drift, and failure points.
- Control usage and optimize costs through model selection, caching, and batching.
- Investigate and resolve production issues across the AI stack.
- Contribute to AI development practices, developer enablement, and practical adoption of new AI techniques and tools.
Requirements
- 4+ years of experience in software engineering, ML engineering, or MLOps/platform engineering.
- 2+ years of experience building and deploying LLM-based systems in production.
- Strong Python skills and experience developing production APIs and backend services.
- Practical experience with LLM solutions, RAG, embeddings, vector databases, and agent orchestration.
- Experience with AWS or GCP and related AI services.
- Experience with Docker, Kubernetes or equivalent technologies, CI/CD, and Infrastructure as Code.
- Experience monitoring and operating AI or ML systems in production.
- Ability to communicate technical decisions clearly to engineering teams and business stakeholders.
- Experience in regulated industries such as pharma, life sciences, healthcare, or fintech is preferred.
- Familiarity with LLM evaluation tools and LLMOps platforms such as Langfuse or MLflow is preferred.
- Knowledge of AI governance, regulatory frameworks, and IT security standards is preferred.
- Experience developing internal tools, supporting developer enablement, or using agentic coding is preferred.
Benefits
- Competitive compensation reviewed annually.
- Country-specific vacation package that increases with tenure.
- Country-specific benefits including private healthcare, fitness, and meal allowances.
- Annual personal development budget.
- Hybrid working, with up to 3 months per year working from anywhere.
- Company-provided equipment and tools.
- Annual in-person company event in Europe.
- The posting states that applications are reviewed manually and that hiring decisions are made by people.
- Equal opportunity and diversity-focused workplace.
Tech Stack
Categories
About Qualifyze GmbH
Qualifyze builds a cloud platform and audit service that help life-sciences companies manage GxP supplier compliance, access audit reports, and monitor supply-chain risk. It monetizes through subscriptions and paid audits, connecting customers with a global network of auditors and analytics on supplier performance. Founded in 2019 and headquartered in Frankfurt, it serves 1,500+ pharmaceutical and healthcare customers and has conducted 4,500+ audits across 85+ countries.