3 days ago
London, United Kingdom
Senior
H1B Sponsor
Responsibilities
- Build and maintain systems for serving AI models to users.
- Maximize compute efficiency to support customer growth.
- Enable high-performance inference infrastructure for research.
- Design intelligent routing algorithms for request distribution.
- Autoscale compute fleets to match supply with demand.
- Build production-grade deployment pipelines for new models.
- Integrate new AI accelerator platforms.
- Analyze observability data to tune performance.
Requirements
- Significant software engineering experience, especially with distributed systems.
- Experience with high-performance, large-scale distributed systems.
- Familiarity with machine learning systems at scale.
- Knowledge of load balancing, request routing, or traffic management.
- Experience with Kubernetes and cloud infrastructure (AWS, GCP).
- Proficiency in Python or Rust.
Benefits
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Collaborative office space.
Tech Stack
AWSGoogle Cloud PlatformKubernetesPythonRust
Categories
AI & MLBackendData Engineering