21 hours ago
Barcelona, SpainSenior
Responsibilities
- Architect a unified GenAI gateway with automated routing, quota controls, and resilient fallback systems across model vendors.
- Improve efficiency, latency, and cost management through traffic management, response caching, token budgeting, and cost allocation controls.
- Build evaluation mechanisms, observability, tracing, telemetry, monitoring, alerting, and cost analytics for GenAI lifecycles.
- Standardize prompt engineering workflows through versioning, automated testing, governance, and production delivery integrations.
- Implement platform guardrails and safe production defaults in partnership with Security and Privacy teams.
- Develop production backend services, platform abstractions, developer-facing APIs or SDKs, and shared libraries.
- Support incident response, on-call operations, and blameless postmortems for GenAI systems.
Requirements
- 5+ years of experience designing, building, and operating backend services or ML infrastructure handling production traffic.
- Strong Python skills and experience building developer-facing APIs, SDKs, or shared libraries.
- Practical experience with GenAI systems, including vector retrieval and external provider APIs.
- Knowledge of distributed systems, high availability, concurrency, caching, and rate limiting.
- Experience with at least one major public cloud and its services and infrastructure, preferably AWS.
- Hands-on experience with distributed tracing, system telemetry, SLOs, and incident triage.
- Strong communication skills, at least C1 English proficiency, and willingness to join a paid on-call rotation.
- Preferred experience includes AI gateways, scalable model serving, evaluation suites, prompt management, vector databases, GenAI observability tooling, Metaflow, Databricks, AWS SageMaker, GPU optimization, dynamic scaling, cost controls, and agentic workflows.
Benefits
- Open, collaborative, dynamic, and diverse culture.
- Monthly allowance for Preply lessons, a Learning & Development budget, and time off for self-development.
- Competitive financial package including equity, leave allowance, and health insurance.
- Attractive relocation package for employees joining the Preply Barcelona Hub from outside Barcelona.
- Access to free mental health support platforms.
- Access to Gympass-partnered wellness and gym centers throughout Spain.
- Opportunity to support learners and tutors through language learning and teaching across 175 countries.
Categories
About Preply
Preply builds an online marketplace that connects learners with human tutors for live language lessons, supported by AI tools. Consumers book 1:1 sessions and ongoing courses, while organizations use Preply Business for corporate language training; revenue comes from commissions and subscriptions. Founded in 2012 and privately held, Preply operates globally with 100,000+ tutors teaching 90+ languages.