Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)
Perplexity3 hours ago
Remote, United Kingdom +4 moreMid Level
Responsibilities
- Design and build search-engine components, including indexing pipelines, data storage formats, retrieval algorithms, and ranking systems at the scale of billions of pages.
- Develop streaming and batch data-processing systems for search-index construction in high-load environments.
- Perform low-level optimization, hardware-performance tuning, memory and cache optimization, SIMD work, and profiling.
- Address multithreading, concurrency, system-level optimization, and distributed-systems challenges.
- Own the full project lifecycle, including how systems are built, deployed, operated, and scaled in production.
Requirements
- 3+ years of hands-on systems-programming experience with Rust, C++, C, or similar languages.
- Knowledge of Python or other scripting languages and data-processing systems such as YT, Kafka, or Hadoop.
- Strong algorithms and data-structures knowledge, including the ability to apply them effectively.
- Deep understanding of multithreading, its approaches, challenges, and trade-offs.
- Experience building high-load, distributed, and hardware-adjacent services.
- Solid understanding of Linux internals, including syscalls, networking stack, memory model, and kernel tuning.
- Familiarity with low-level optimization techniques such as memory management, cache efficiency, SIMD, and profiling.
- Preferred: experience with search engines, databases, information-retrieval systems, trading systems, or other latency-sensitive real-time systems.
- Preferred: understanding of indexing, query parsing, ranking, and relevance, plus familiarity with cloud services, Kubernetes, and AWS infrastructure.
Tech Stack
Categories
BackendData Engineering
About Perplexity
Perplexity builds an AI-powered answer engine for web and mobile and an enterprise product, Perplexity Computer, for AI-driven workflows across tools and apps. The company monetizes through individual subscriptions (Perplexity Pro) and enterprise plans. Founded in 2022 and headquartered in San Francisco, it operates as a privately held company.