Member of Technical Staff (Backend Software Engineer, Search Crawler)
Perplexity11 months ago
Berlin, Germany or London, United KingdomSenior / Staff+
H1B Sponsor
Responsibilities
- Lead projects to develop large-scale web crawlers and ingestion pipelines.
- Build and optimize backend and frontend components for crawler services.
- Collaborate with Search and Infrastructure teams for reliable data ingestion.
- Architect scalable distributed systems for high-load data operations.
- Continuously enhance system performance and usability.
Requirements
- Minimum of 5 years of software development experience.
- Strong knowledge of data structures and algorithms in Python, C++, Rust, or Go.
- Experience with large-scale web crawlers is highly desirable.
- Proven experience with high-load, distributed services.
- Deep understanding of cloud infrastructure, especially Kubernetes and AWS.