Member of Technical Staff (Search Crawler Analyst)
Perplexity1 month ago
Berlin, Germany or London, United KingdomMid Level
Responsibilities
- Diagnose quality issues in the crawling pipeline.
- Design metrics and build data pipelines to improve search and answer quality.
- Train small ML models for pipeline optimization and parsing quality.
- Build model-training datasets, including LLM-as-a-judge labeling pipelines.
- Improve page-selection algorithms for indexing.
- Design and analyze experiments to validate improvements.
Requirements
- 4+ years of experience as a data analyst, ML engineer, or in a related role.
- Strong coding skills and the ability to write production-grade code at a mid-level backend engineering standard.
- Experience designing metrics from scratch.
- Experience training ML models that shipped to production with measurable metric improvements.
- Direct experience with web crawling or indexing pipelines is preferred.
Categories
Data EngineeringML Engineering
About Perplexity
Perplexity builds an AI-powered answer engine for web and mobile and an enterprise product, Perplexity Computer, for AI-driven workflows across tools and apps. The company monetizes through individual subscriptions (Perplexity Pro) and enterprise plans. Founded in 2022 and headquartered in San Francisco, it operates as a privately held company.