11 hours ago
London, United KingdomStaff+
Responsibilities
- Design, implement, and operate core runtime services for serving search queries at scale.
- Build and optimize query processing, retrieval orchestration, and response assembly flows under strict latency budgets.
- Develop systems that maintain performance and predictability under high load.
- Optimize CPU, memory, and data access patterns in performance-critical paths.
- Ensure reliability and observability across production services, including structured logs, metrics, traces, and latency breakdowns.
- Monitor throughput, latency, and resource usage and drive performance and cost-efficiency improvements.
- Collaborate with indexing and ML teams to integrate retrieval and ranking components while decoupling ML logic from core system internals.
- Support controlled rollouts, experimentation, and rigorous benchmarking.
Requirements
- 8+ years of experience as a software engineer working on production backend systems.
- Strong hands-on expertise with C++ or Rust in real-world, high-load services.
- Experience building and operating high-load, low-latency user-facing systems handling thousands of requests per second under strict latency constraints.
- Systems-level understanding of CPU, memory, networking, and data access performance.
- Experience deploying, debugging, operating, and rolling back changes to production code.
- Ability to reason end-to-end about request flows and balance correctness, latency, and development velocity.
- Effective collaboration and communication across engineering, ML, and product teams.
- Preferred experience with DBMS internals, cloud infrastructure, high-load web applications, large-scale APIs, performance-critical systems, low-level performance tuning, open-source contributions, competitive programming, CTFs, advanced technical programs such as SHAD, conference talks, or technical publications.
- Willingness to complete coding interviews.
Benefits
- Competitive compensation.
- Career growth and learning opportunities.
- Flexibility and ownership.
- Collaborative and innovative culture.
- Opportunity to work on impactful AI projects.
- International environment with talented teams.
About Nebius
Nebius builds a full-stack AI cloud offering GPU compute, storage, and tools for training and deploying ML models for startups, enterprises, and research labs. It sells consumption-based cloud infrastructure (IaaS/PaaS) and managed services tailored to generative AI workloads, including large-scale model training and inference. The company is headquartered in Amsterdam and operates as an independent provider.