4 days ago
Remote, Worldwide or Bucharest, RomaniaSenior
Responsibilities
- Scale the CNC data plane into a horizontally scalable fetch scheduler handling geo-routing, site cooldowns, quotas, and 50–100 million requests per day.
- Design and ship the Fleet Manager control plane with provider adapters, inventory and health management, reconciliation, configuration, rollout control, and BigQuery metrics export.
- Operate and improve the CONNECT proxy gateway, edge session handling, proxy leases, IP reputation, and request scheduling.
- Engineer mTLS gRPC, long-polling and streaming over unreliable residential links, NAT behavior, carrier-grade NAT, and bandwidth accounting.
- Define SLOs and observability, support safe blue/green rollouts, participate in on-call rotations, lead incident post-mortems, and improve platform reliability.
- Write technical design documents, review squad designs, and apply distributed-systems principles including consistency, backpressure, idempotency, and blast-radius control.
Requirements
- 5+ years of production Rust experience shipping and operating end-to-end services.
- Experience designing and running distributed schedulers, control planes, or stateful services at scale, with knowledge of consistency, partitions, backpressure, and idempotency.
- Deep TCP, TLS, HTTP, gRPC, long-lived connection, NAT, and lossy-network expertise.
- Experience building or operating forward proxies, proxy gateways, or residential/ISP proxy infrastructure, including IP reputation, session stickiness, and pool health.
- Experience with SLOs, error budgets, observability, production incidents, and on-call operations.
- Comfort running Rust across Windows, Linux, and Android and working with FFI boundaries.
- Strong written communication for a globally distributed, remote-first environment.
- Bonus qualifications include mobile or desktop Rust, fleet or device management, anti-bot and fingerprinting knowledge, web scraping and crawling experience, and open-source contributions to Rust, networking, or distributed-systems projects.
Benefits
- Remote-first work from anywhere with flexible working hours and high organizational trust.
- Conference attendance and opportunities to meet teammates globally.
- Work with a self-motivated, multicultural team and cutting-edge open-source technologies and tools.
- Collaborate with distributed systems engineers and data specialists across the globe.
Tech Stack
C++Google BigQueryGoogle Cloud PlatformGrafanagRPCJavaKubernetesLinuxmacOSPrometheusPythonRustTerraformWindows
Categories
About Zyte
Zyte builds SaaS and services for extracting structured data from public websites, including Zyte API for crawling/unblocking/extraction, Smart Proxy Manager, and fully managed data projects for enterprise teams. Its business model combines subscriptions with professional services. Founded in 2010 and headquartered in Ballincollig, Cork, the privately held company is the original author and ongoing maintainer of the Scrapy web-scraping framework.