Member of Technical Staff (Backend Software Engineer, Search Crawler)
Perplexityover 1 year ago
Berlin, Germany or London, United KingdomSenior
Responsibilities
- Own and lead projects focused on large-scale web crawlers, ingestion pipelines, and data-processing systems.
- Build, maintain, and optimize backend and frontend components for crawler services, including storage, retrieval, and data-management dashboards.
- Collaborate with Search and Infrastructure teams to reliably ingest and process billions of web pages.
- Architect and implement full-stack features and scalable distributed systems for high-load and real-time data operations.
- Iterate on system performance, usability, and reliability while experimenting with new approaches.
Requirements
- At least 5 years of software development experience.
- Strong data structures and algorithms knowledge in at least one of Python, C++, Rust, or Go.
- Experience with large-scale web crawlers is highly desirable.
- Proven experience building, deploying, and optimizing high-load, distributed, and hardware-adjacent services.
- Deep understanding of cloud infrastructure with hands-on Kubernetes and AWS experience.
- Ability and interest in writing clean, efficient, and scalable systems.
About Perplexity
Perplexity builds an AI-powered answer engine for web and mobile and an enterprise product, Perplexity Computer, for AI-driven workflows across tools and apps. The company monetizes through individual subscriptions (Perplexity Pro) and enterprise plans. Founded in 2022 and headquartered in San Francisco, it operates as a privately held company.