Staff Software Engineer, Streaming
Judi Health13 days ago
Charlotte, NC, USA +2 moreStaff+
Base Salary
$167k - $251k/yr
Responsibilities
- Design, build, and operate the WAL replication and event streaming platform used by cache invalidation, data warehouse synchronization, and CDC consumers.
- Own replication topology, delivery guarantees, performance and correctness contracts, operational recovery, and post-incident reviews.
- Lead the migration from batch-driven warehouse synchronization to a unified WAL-based replication pipeline using an open table format as the canonical source.
- Drive adoption of event-driven design practices by producing architectural guidance and eliminating consumption anti-patterns.
- Set the technical bar through design reviews, code reviews, and mentorship of senior engineers.
- Participate in a 24/7 on-call rotation for operational support and incident response.
Requirements
- 10+ years of production engineering experience specializing in realtime data infrastructure and event streaming systems.
- Experience designing and operating WAL-based or log-structured replication systems such as PostgreSQL logical replication, Debezium, Kafka Connect, or equivalent CDC frameworks at scale.
- Deep understanding of ordering guarantees, at-least-once and exactly-once delivery semantics, idempotency, consumer lag management, and failure recovery.
- Experience leading batch-to-streaming migrations and event-driven architecture initiatives without disrupting dependent consumers.
- Fluency in Rust, Go, or C/C++ for production high-throughput, low-latency data-plane components.
- Track record of leading cross-team technical initiatives through influence and durable architectural documentation.
- Strong written and verbal communication and the ability to operate with ambiguity and drive solutions from first principles to production.
- Experience supporting 24/7 production on-call rotations and resolving incidents outside standard business hours.
- Preferred experience with Rust for streaming pipeline components and with open table formats such as Apache Iceberg, Delta Lake, or Parquet.
- Preferred experience integrating streaming pipelines with Redshift, Snowflake, BigQuery, ClickHouse, or Databricks, including schema evolution and backfill strategies.
- Preferred familiarity with PostgreSQL WAL internals, Kafka, Kinesis, Redpanda, Pulsar, AWS data infrastructure, and regulated data domains.
Benefits
- Hybrid work arrangement requiring 3 days in the office, with offices in NYC, Denver, and the Charlotte, NC area.
Tech Stack
Categories
BackendData Engineering