1 year ago
Paris, France +2 moreSenior
Responsibilities
- Build and operate large-scale, high-throughput data pipelines for AI-ready web search.
- Develop and optimize data ingestion and transformation systems across structured and unstructured sources.
- Manage and scale data storage layers for performance and reliability.
- Participate in architecture discussions and contribute to data infrastructure system design.
- Collaborate with ML and backend teams to deliver high-quality, real-time data for ranking and retrieval.
- Write clean, maintainable code and participate in code reviews.
- Build streaming and transformation systems for billions of web facts per day under freshness SLAs of less than five minutes.
- Develop real-time data lakes serving embeddings, metadata, and ranking features to LLMs.
- Design fault-tolerant pipelines for continuous crawling, deduplication, and enrichment.
- Develop internal tools to monitor and profile data flows across terabytes of web-scale content.
Requirements
- At least three years of experience in data engineering or backend development.
- Understanding of distributed systems, data modeling, and streaming architectures.
- Focus on data quality, observability, and system reliability.
- Ability to debug complex pipeline issues and optimize for latency or throughput.
- Curiosity about AI infrastructure, indexing systems, and retrieval-augmented generation.
- Ability to work in a fast-paced, high-ownership startup environment.
- Interest in Linkup’s mission to build search infrastructure for AI agents.
Benefits
- Flexible remote-work policy.
- Opportunity to work closely with the founders and play a central role on a small technical team.
- Opportunity to build AI-powered search and agentic-web infrastructure.
Tech Stack
Categories
Data Engineering
About Linkup
At Linkup, we get your AI off airplane mode and connect it to the internet with our state-of-the-art web search API.