about 5 hours ago
Berlin, GermanySenior
Responsibilities
- Design and maintain scalable ML/LLM infrastructure and pipelines.
- Productionize traditional ML and generative AI solutions with cross-functional product teams.
- Own the ML/LLMOps lifecycle: prompting, deployment, monitoring, evaluation, and optimization.
- Build and evolve an LLM Gateway service to standardize access, routing, and governance.
- Develop evaluation frameworks to measure quality, performance, and reliability of LLM outputs.
- Design and implement MCP-compatible services for standardized context exchange.
- Integrate MCP into internal platforms to support tool use and workflows.
- Work with AWS and integrate self-hosted open-source AI models.
- Ensure observability, cost efficiency, and system performance.
- Contribute to project management, stakeholder communication, and cross-team collaboration.
Requirements
- Strong experience in MLOps (CI/CD, Docker, Kubernetes) and operating production-grade systems.
- Proficiency in Python and solid software engineering and scalable system design skills.
- Hands-on experience with LLMs and generative AI technologies (e.g., GPT, Gemini, Anthropic-like models).
- Expertise in prompt engineering, agent orchestration, context management, and output validation.
- Experience with LLM evaluation frameworks and deploying self-hosted LLMs.
- Familiarity with cloud platforms (e.g., AWS, GCP) as well as DevOps, testing, and observability practices.
- Strong communication skills and ability to collaborate with cross-functional teams and stakeholders.
Benefits
- Competitive salary package and a bonus.
- Hybrid work model with three days on-site and 30 days of vacation per year.
- Possibility to work from abroad for 10 days per year.
- Relocation support with visa process and attractive package.
- Access to plus membership for tenants on ImmoScout24.
- Dedicated learning time, online courses, and structured feedback.
- Professional family service for childcare support.
- Bring your dog to work policy.
- Subsidized public transport or Job Bikes.
- Commitment to sustainability and diversity initiatives.
- Company pension scheme with attractive subsidy.
- Innovative office environment with various amenities.