20 hours ago
Remote, Worldwide or Lisbon, PortugalStaff+
Responsibilities
- Architect and build Zyte’s control and context planes, including service registries, schema registries, SLO enforcement, CLI tooling, operational telemetry, and automated feedback loops.
- Own the service chassis and golden path through multi-language Java and Python client libraries, workload specifications, Helm charts, and deployment pipelines.
- Define gRPC and Protocol Buffer contracts, gateway transcoding, versioning policies, and schema evolution practices.
- Operate Kubernetes-based platform infrastructure across OCI, Hetzner, Servers.com, and GCP, along with Terraform, ingress systems, Kafka, billing pipelines, Valkey, and database modernization.
- Lead architectural RFDs covering workflow orchestration, gateway orchestration, multi-cluster routing, and automated failover.
- Establish reliability practices including SLOs, error budgets, health-aware traffic isolation, weighted canary deployments, incident post-mortems, and platform improvements.
- Mentor engineers, review system proposals, establish engineering standards, and influence architecture across five neighboring squads.
Requirements
- 10+ years of experience building scalable distributed backend systems and authoring internal platforms or core libraries adopted by engineering teams.
- Expertise in Java, including reactive frameworks such as Vert.x or Netty, together with strong Python proficiency.
- Deep experience with gRPC and Protobuf, schema evolution, and backward compatibility in mission-critical systems.
- Hands-on production experience with Kubernetes at scale, Terraform, and Kafka-based event streaming.
- Experience designing automated telemetry pipelines, materialized views, or feature stores that adapt system behavior using production data.
- Experience defining SLOs and SLIs, analyzing blast radius, and designing fault-tolerant systems around service contracts.
- Strong technical writing, communication, technical alignment, and problem-solving skills in a globally distributed environment.
- Bonus experience with Temporal, DBOS, model serving, performance monitoring, drift detection, SPIRE, mTLS, Cilium, Istio, Envoy, developer tooling, web scraping, crawling, or open-source distributed-systems contributions.
Benefits
- Remote-first work from anywhere with flexible working hours and high organizational trust.
- Opportunities to attend conferences and meet global team members.
- Work with a self-motivated, multicultural, distributed engineering and data community.
- Work with cutting-edge open-source technologies and tools.
Tech Stack
AmbassadorApache HBaseCircleCIGoogle BigQueryGoogle Cloud PlatformGrafanagRPCHelmIstioJavaKubernetesMySQLPostgreSQLPrometheusPythonTerraform
About Zyte
Zyte builds SaaS and services for extracting structured data from public websites, including Zyte API for crawling/unblocking/extraction, Smart Proxy Manager, and fully managed data projects for enterprise teams. Its business model combines subscriptions with professional services. Founded in 2010 and headquartered in Ballincollig, Cork, the privately held company is the original author and ongoing maintainer of the Scrapy web-scraping framework.