Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)
Perplexity2 months ago
Remote, United Kingdom +4 moreMid Level
Responsibilities
- Design and build indexing pipelines, data-storage formats, retrieval algorithms, and ranking systems operating at the scale of billions of pages.
- Develop streaming and batch data-processing systems for search-index construction in high-load environments.
- Perform low-level optimization and systems-level tuning to maximize hardware performance.
- Solve multithreading, concurrency, and system-level optimization challenges.
- Own systems across the full lifecycle, including building, deploying, operating, and scaling them in production.
Requirements
- 3+ years of hands-on systems-programming experience with Rust, C++, C, or similar languages.
- Knowledge of Python or other scripting languages.
- Knowledge of data-processing systems such as YT, Kafka, or Hadoop.
- Strong algorithms and data-structures knowledge, with the ability to apply it effectively.
- Deep understanding of multithreading, including different approaches, challenges, and trade-offs.
- Experience building high-load, distributed, and hardware-adjacent services.
- Solid understanding of Linux internals, including syscalls, networking stack, memory model, and kernel tuning.
- Familiarity with low-level optimization techniques such as memory management, cache efficiency, SIMD, and profiling.
- Preferred experience developing search-engine or database components, information-retrieval systems, trading systems, or other latency-sensitive real-time systems.
- Preferred familiarity with search fundamentals, cloud services, Kubernetes, and AWS infrastructure.
Tech Stack
Categories
BackendData Engineering
About Perplexity
Perplexity builds an AI-powered answer engine for web and mobile and an enterprise product, Perplexity Computer, for AI-driven workflows across tools and apps. The company monetizes through individual subscriptions (Perplexity Pro) and enterprise plans. Founded in 2022 and headquartered in San Francisco, it operates as a privately held company.