7 hours ago
Base Salary
$180k - $350k/yr
Responsibilities
- Build a distributed crawler capable of handling more than 100 million pages per day.
- Optimize crawl politeness and rate limiting across thousands of domains.
- Design systems to detect and handle dynamic content, JavaScript rendering, and anti-bot measures.
- Create intelligent crawl scheduling and prioritization algorithms to maximize coverage efficiency.
Requirements
- Have extensive experience building and scaling web crawlers, or be able to ramp up very quickly.
- Have experience with a high-performance language such as C++ or Rust.
- Be familiar with TypeScript, Playwright, modern web design, and CDP (Chrome DevTools Protocol).
- Be comfortable optimizing systems to an exceptional degree.
- Care about finding high-quality knowledge and its importance to the world.
Benefits
- In-person opportunity in Zurich.
- Premium medical, dental, and vision healthcare benefits.
- Fertility benefits.
- 16 weeks of fully paid parental leave for all new parents.
- Monthly wellness stipend.
- International visa sponsorship is available, including STEM OPT, OPT, H1B, O1, and E3; visa approval is not guaranteed.
Tech Stack
Categories
About Exa
Exa builds a web-scale search engine and API for AI agents and developer applications, combining its own crawler, embedding models, and high-performance vector search. It sells usage-based APIs and enterprise integrations that power retrieval-augmented generation, browsing, and automation on live web content. The company runs large crawling infrastructure and dedicated GPU clusters to continuously index and embed pages, and ships low-latency search components written in Rust.