1 month ago
Remote, United StatesStaff+
Responsibilities
- Design and develop multi-threaded asynchronous replication systems with parallel streaming capabilities.
- Build object-level delta replication with checkpointing and resume functionality.
- Develop replication engines with bucket- and share-level replication controls.
- Implement secure data transfer using TLS 1.3 with mutual authentication.
- Build checksum validation, verification pipelines, metadata tracking, and change detection systems.
- Design manual failover workflows and disaster recovery capabilities.
- Build and maintain APIs for replication configuration, control, and automation.
- Implement RPO visibility, alerting, monitoring dashboards, and replication health insights.
- Ensure high availability, fault tolerance, scalability, and data integrity.
- Partner with QA and engineering teams to validate performance, resiliency, scale, and end-to-end replication workflows.
- Debug production issues, improve replication reliability, and provide technical leadership, architectural guidance, and mentorship.
Requirements
- At least 8 years of experience in distributed systems, storage systems, or backend software engineering.
- Strong programming skills in one or more of C++, Go, Java, or Rust.
- Experience designing and building data replication systems, data pipelines, or distributed data services.
- Deep understanding of consistency, availability, scalability, and fault tolerance in distributed systems.
- Strong expertise in multithreading, concurrency, and parallel processing.
- Knowledge of TCP/IP, HTTP/HTTPS, TLS, and secure communication protocols.
- Experience implementing checksums, validation, and consistency checks.
- Experience designing and building REST APIs and service-based architectures.
- Familiarity with checkpointing, failure recovery, and retry mechanisms.
- Basic understanding of metrics, logging, and alerting.
- Strong debugging, problem-solving, and system design skills.
- Preferred: experience with asynchronous replication, disaster recovery, backup systems, object storage, large-scale storage, delta encoding, change data capture, incremental synchronization, high-throughput data movement, mutual TLS, encryption, authentication, enterprise data platforms, or large-scale system performance tuning.
