5 months ago
Amsterdam, Netherlands or London, United KingdomSenior
Responsibilities
- Design, implement, and operate large-scale indexing systems and data pipelines.
- Build ingestion workflows for internal and external sources, including web-scale crawling and structured feeds.
- Develop and optimize indexing strategies for performance, freshness, and efficiency.
- Work on storage formats, compaction strategies, and update mechanisms.
- Ensure reliability and predictability under high-throughput conditions.
- Build well-tested components with clear contracts and architectural flexibility.
- Define observability primitives, including logs, metrics, and data quality signals, across pipelines.
- Monitor and optimize throughput, resource usage, and cost.
- Collaborate with runtime and ML teams to support retrieval and ranking requirements.
- Enable safe experimentation with indexing strategies and data processing logic.
Requirements
- At least 5 years of experience building production backend or data systems.
- Strong proficiency in Go, C++, or Rust.
- Experience with high-load systems, such as systems handling 10k+ requests per second or 10+ GiB/sec throughput.
- Experience with databases, data planes, or large-scale data pipelines.
- Understanding of distributed systems fundamentals and failure modes.
- Production operations experience and the ability to handle real-world technical tradeoffs.
- Ability to reason about systems and data flows rather than isolated components.
- Ability to make pragmatic decisions while maintaining long-term system health.
- Effective collaboration across infrastructure, ML, and product teams.
- Strong candidates may also have experience with Spark, Flink, MapReduce, Beam, web crawling, scraping, proxying, anti-bot infrastructure, ad tech, social networks, large-scale content platforms, DBMS, cloud infrastructure, open-source contributions, competitive programming, CTFs, SHAD or similar advanced technical programs, conference talks, or technical publications.
- Coding interviews are part of the hiring process.
Benefits
- Competitive salary and comprehensive benefits package.
- Opportunities for professional growth within Nebius.
- Flexible working arrangements.
- Dynamic and collaborative work environment.
- Global R&D hubs across Europe, North America, and Israel.
Tech Stack
Categories
BackendData Engineering
About Nebius
The Nebius AI Cloud brings powerful full-stack infrastructure for AI developers and practitioners across startups, enterprises and science institutes to build and deploy generative AI applications and rapidly deliver scientific breakthroughs by training and running ML models within a secure, high-performance, and cost-optimized cloud environment.