1 day ago
Amsterdam, Netherlands or London, United Kingdom
Senior
Responsibilities
- Design, implement, and operate large-scale indexing systems and data pipelines.
- Build ingestion workflows for internal and external data sources.
- Develop and optimize indexing strategies for performance and efficiency.
- Work on storage formats, compaction strategies, and update mechanisms.
- Ensure reliability and predictability under high-throughput conditions.
- Build well-tested components with clear contracts.
- Define observability primitives across pipelines.
- Monitor throughput, resource usage, and optimize when needed.
- Collaborate with runtime and ML teams to support retrieval and ranking requirements.
- Enable safe experimentation on indexing strategies and data processing logic.
Requirements
- 5+ years of experience building production backend or data systems.
- Strong in Go, C++, or Rust.
- Experience with high-load systems (e.g. 10k+ RPS or 10+ GiB/sec throughput).
- Experience with databases, data planes, or large-scale data pipelines.
- Understanding of distributed systems fundamentals and failure modes.
- Experience operating systems in production and handling real-world tradeoffs.
- Ability to think in terms of systems and data flows.
- Ability to make pragmatic decisions without compromising long-term system health.
- Effective collaboration across infrastructure, ML, and product teams.
Benefits
- Competitive salary and comprehensive benefits package.
- Opportunities for professional growth within Nebius.
- Flexible working arrangements.
- A dynamic and collaborative work environment that values initiative and innovation.
Tech Stack
Apache BeamApache FlinkApache SparkC++GoRust
Categories
AI & MLBackendData Engineering