Member of Technical Staff (Search Crawler Analyst)
Perplexity13 hours ago
Berlin, Germany or London, United KingdomMid Level / Senior
Responsibilities
- Find and diagnose quality issues in the crawling pipeline.
- Train small machine-learning models to optimize pipeline components such as parsing quality.
- Build datasets for model training, including LLM-as-a-judge labeling pipelines.
- Improve page-selection algorithms for indexing.
- Design and analyze experiments to validate system improvements.
Requirements
- 4+ years of experience as a data analyst, ML engineer, or in a related role.
- Strong coding skills and the ability to write production-grade code at a mid-level backend-engineering standard.
- Experience designing metrics from scratch.
- Experience training machine-learning models that shipped to production and produced measurable metric improvements.
- Direct experience with web crawling or indexing pipelines is preferred.
Categories
Data EngineeringML Engineering
About Perplexity
Perplexity builds an AI-powered answer engine for web and mobile and an enterprise product, Perplexity Computer, for AI-driven workflows across tools and apps. The company monetizes through individual subscriptions (Perplexity Pro) and enterprise plans. Founded in 2022 and headquartered in San Francisco, it operates as a privately held company.