6 months ago
Amsterdam, Netherlands or London, United KingdomSenior
Responsibilities
- Design, implement, and operate large-scale indexing systems and data pipelines.
- Build ingestion workflows for internal and external sources, including web-scale crawling and structured feeds.
- Develop and optimize indexing strategies for performance, freshness, and efficiency.
- Work on storage formats, compaction strategies, and update mechanisms.
- Ensure reliability and predictability under high-throughput conditions.
- Build well-tested components with clear contracts and architectural flexibility.
- Define observability primitives, including logs, metrics, and data quality signals, across pipelines.
- Monitor and optimize throughput, resource usage, and cost.
- Collaborate with runtime and ML teams to support retrieval and ranking requirements.
- Enable safe experimentation with indexing strategies and data processing logic.
Requirements
- At least 5 years of experience building production backend or data systems.
- Strong proficiency in Go, C++, or Rust.
- Experience with high-load systems, such as systems handling 10k+ requests per second or 10+ GiB/sec throughput.
- Experience with databases, data planes, or large-scale data pipelines.
- Understanding of distributed systems fundamentals and failure modes.
- Production operations experience and the ability to handle real-world technical tradeoffs.
- Ability to reason about systems and data flows rather than isolated components.
- Ability to make pragmatic decisions while maintaining long-term system health.
- Effective collaboration across infrastructure, ML, and product teams.
- Strong candidates may also have experience with Spark, Flink, MapReduce, Beam, web crawling, scraping, proxying, anti-bot infrastructure, ad tech, social networks, large-scale content platforms, DBMS, cloud infrastructure, open-source contributions, competitive programming, CTFs, SHAD or similar advanced technical programs, conference talks, or technical publications.
- Coding interviews are part of the hiring process.
Benefits
- Competitive salary and comprehensive benefits package.
- Opportunities for professional growth within Nebius.
- Flexible working arrangements.
- Dynamic and collaborative work environment.
- Global R&D hubs across Europe, North America, and Israel.
Tech Stack
Categories
BackendData Engineering
About Nebius
Nebius builds a full-stack AI cloud offering GPU compute, storage, and tools for training and deploying ML models for startups, enterprises, and research labs. It sells consumption-based cloud infrastructure (IaaS/PaaS) and managed services tailored to generative AI workloads, including large-scale model training and inference. The company is headquartered in Amsterdam and operates as an independent provider.