Staff Software Engineer, Replication Foundations
Temporal Technologies18 hours ago
Base Salary
$170k - $278k/yr
Responsibilities
- Set the technical direction and evolve Temporal’s OSS replication architecture from problem definition through rollout and operational support.
- Design and implement replication protocols for high-availability namespaces, cross-cluster and cross-region replication, and migration between Temporal clusters.
- Lead scalability and reliability initiatives including multi-cell namespaces, multi-cluster namespaces, load distribution, and hotspot handling.
- Define system-level guarantees for consistency, ordering, idempotency, failure recovery, performance, and operational behavior.
- Identify architectural risks and shape the technical roadmap for replication capabilities.
- Partner with Cloud Enablement, CGS, Product, and engineering teams to align replication foundations with customer and product needs.
- Lead design reviews, improve implementation and testing practices, mentor engineers, and provide technical guidance.
- Debug complex production issues, participate in incident response, and drive follow-up improvements related to replication and core system behavior.
Requirements
- Track record designing and delivering complex production distributed systems where correctness, availability, and performance are critical.
- Deep understanding of replication, partitioning, consistency, fault tolerance, durability, concurrency, and failure recovery.
- Experience defining system architecture, protocol behavior, invariants, and trade-offs in ambiguous or evolving problem spaces.
- Experience debugging concurrency bugs, data inconsistencies, partial failures, and performance bottlenecks in production.
- Proficiency writing production-quality concurrent code in Go.
- Strong written and verbal communication skills for explaining complex designs and trade-offs to technical and cross-functional audiences.
- Ability to influence technical direction across teams without direct authority and mentor engineers.
- Experience designing or maintaining replication protocols or data-plane infrastructure is preferred.
- Experience with multi-cluster or multi-region architectures, including active-active or active-passive systems, is preferred.
- Familiarity with database internals, log-based replication, or event-sourced systems is preferred.
- Prior contributions to large open-source projects or distributed-systems infrastructure are preferred.
- Experience with Java, C++, or similar systems languages is welcome.
About Temporal Technologies
Temporal Technologies builds an open-source durable workflow platform that software teams use to orchestrate long-running, stateful application logic across services. It monetizes through a managed cloud offering and commercial support for its server and SDKs. Founded in 2019 and headquartered in Bellevue, Washington, it lists public adopters such as Netflix, Snap, Indeed, and Datadog.