about 2 hours ago
London, United KingdomMid Level / Senior
H1B Sponsor
Responsibilities
- Build and maintain fault-tolerant, high-performance systems for serving LLMs.
- Develop an internal platform for LLM capability discovery.
- Collaborate with researchers and engineers to optimize models for production.
- Conduct architecture and design reviews to ensure best practices.
- Develop monitoring and observability solutions for system health.
- Lead projects from requirements gathering to implementation.
Requirements
- 4+ years of experience in building large-scale backend systems.
- Strong programming skills in languages like Python, Go, Rust, or C++.
- Experience with LLM serving fundamentals such as rate limiting and load balancing.
- Familiarity with containers and orchestration tools like Docker and Kubernetes.
- Experience with cloud infrastructure (AWS, GCP) and infrastructure as code (Terraform).
- Proven problem-solving skills and ability to work independently.