21 hours ago
London, United KingdomSenior
Responsibilities
- Architect a unified GenAI gateway with automated routing, quota controls, and resilient fallback systems across model vendors.
- Improve system efficiency and latency through traffic management, response caching, token budgeting, and cost allocation controls.
- Build evaluation mechanisms, prompt engineering workflows, observability, telemetry, monitoring, alerting, and safety guardrails for GenAI lifecycles.
- Write production code and shape platform abstractions, operational standards, and self-service capabilities for product teams.
- Partner with Applied Science, Data, Product, Security, Privacy, and Engineering teams on platform evolution.
- Participate in incident response, blameless postmortems, monitoring, and a paid on-call rotation.
Requirements
- 5+ years designing, building, and operating backend services or ML infrastructure handling production traffic.
- Strong Python skills and experience building developer-facing APIs, SDKs, or shared libraries.
- Practical experience with GenAI systems, including vector retrieval and external provider APIs.
- Hands-on experience using agentic AI and establishing quality gates and safety nets for engineering workflows.
- Knowledge of distributed systems, high availability, concurrency, caching, and rate limiting.
- Experience with at least one major public cloud and its services and infrastructure, preferably AWS.
- Experience with distributed tracing, system telemetry, SLOs, and incident triage.
- Strong communication skills, C1-level English, and willingness to join a paid on-call rotation.
- Preferred: experience with AI gateways, scalable model serving, evaluation suites, prompt management, vector databases, GenAI observability tooling, Metaflow, Databricks, AWS SageMaker, open-source foundation models, GPU optimization, dynamic scaling, infrastructure cost controls, agentic workflows, multi-agent frameworks, or tool-use patterns.
Benefits
- Open, collaborative, dynamic, and diverse culture.
- Monthly allowance for lessons, a Learning & Development budget, and time off for self-development.
- Competitive financial package including equity, leave allowance, and health insurance.
- Access to free mental health support platforms.
- Access to Gympass-partnered wellness and gym centers throughout London.
- Opportunity to support learners and tutors through language learning and teaching across 175 countries.
Categories
About Preply
Preply builds an online marketplace that connects learners with human tutors for live language lessons, supported by AI tools. Consumers book 1:1 sessions and ongoing courses, while organizations use Preply Business for corporate language training; revenue comes from commissions and subscriptions. Founded in 2012 and privately held, Preply operates globally with 100,000+ tutors teaching 90+ languages.