29 days ago
London, United KingdomMid Level
Responsibilities
- Build infrastructure that moves GenAI ideas from prototype to production.
- Develop real-time GPU endpoints, high-throughput batch inference, fine-tuning pipelines, LLM and Agent Gateways, evaluation infrastructure, guardrails, and cost attribution.
- Design scalable systems for model serving, batch inference, GPU autoscaling, utilization, and fine-tuning.
- Optimize GPU inference and fine-tuning for cost, latency, throughput, reliability, fallback behavior, observability, and cost controls.
- Build production platforms with monitoring, SLOs, playbooks, and operational excellence.
- Partner with ML engineers, product engineers, data scientists, and platform teams across DoorDash, Wolt, and Deliveroo.
- Help shape future platform capabilities including reinforcement learning, agent optimization, post-training, and agentic techniques.
Requirements
- BSc, MSc, or PhD in Computer Science or equivalent experience.
- At least 3 years of industry experience in software engineering.
- Strong backend engineering fundamentals, especially in Python and distributed systems.
- Experience building production services, APIs, data pipelines, or machine learning infrastructure at scale.
- Production operations experience covering observability, debugging, reliability, incident response, and performance or cost optimization.
- Hands-on production experience with LLM inference or fine-tuning of open-weight models, including serving, batching, autoscaling, GPU utilization, SFT, DPO, or LoRA.
- Ability to turn customer use cases into reusable platform capabilities in ambiguous, fast-moving technical areas.
- Proficiency with AI coding tools such as Claude Code, Codex, or Cursor across the software development lifecycle.
- Preferred experience with vLLM, SGLang, TensorRT-LLM, distributed fine-tuning, GPU performance optimization, Kubernetes, AWS, GCP, Modal, LLM gateways, developer platforms, AI agents, MCP servers, evaluation systems, observability, tracing, RAG, search, or vector databases.
Tech Stack
Categories
About Deliveroo
Deliveroo is an award-winning delivery service founded in 2013 by William Shu and Greg Orlowski. Deliveroo works with approximately 176,000 best-loved restaurants and grocery partners, as well as around 150,000 riders to provide the best food delivery experience in the world. Deliveroo is headquartered in London, with offices around the globe. Deliveroo operates across 9 markets, including Belgium, France, Italy, Ireland, Qatar, Singapore, United Arab Emirates, Kuwait and the United Kingdom.