Staff Software Engineer, OTA Services
Horizon3 AI2 hours ago
Remote, United StatesStaff+
Base Salary
$230k - $260k/yr
Responsibilities
- Design and own the over-the-air update system, including delivery protocols, version negotiation, rollout orchestration, health verification, and automatic rollback.
- Build and operate systems that track the version state of every NodeZero deployment, including pending and stuck updates.
- Design phased rollouts, canary deployments, customer pinning, and emergency hold mechanisms.
- Develop reliable delivery mechanisms for air-gapped networks, strict egress policies, and minimal-footprint deployments.
- Own OTA reliability end-to-end and participate in on-call incident response for delivery failures, stuck updates, and version drift.
- Set technical direction, produce architecture designs, and drive decisions across team boundaries.
- Mentor P4 engineers through design reviews, code reviews, and technical pairing.
Requirements
- 8+ years of professional software engineering experience with deep specialization in distributed systems, remote update systems, or fleet-management infrastructure.
- Deep understanding of remote update design, including delivery protocols, version negotiation, delta delivery, health verification, and rollback semantics.
- Experience designing rollout strategies for software deployed across heterogeneous, customer-managed environments.
- Strong proficiency in Go, Python, or Rust for systems-level infrastructure work.
- Experience building software for constrained or air-gapped environments.
- Deep understanding of Kubernetes and how deployments are managed, updated, and monitored in running clusters.
- Experience with container image distribution, including OCI artifacts, image manifests, layer caching, and registry protocols.
- Strong understanding of mTLS, certificate lifecycle, and secure-channel establishment for update delivery.
- Track record of setting engineering standards and producing architecture documents that drive technical decisions across teams.
- Experience mentoring mid-level engineers through design and code review.
- Experience with Kubernetes operators or controller patterns is preferred.
- Cybersecurity or regulated/high-security software experience is preferred.
- Familiarity with Fleet or similar open-source fleet-management tools is preferred.
- Experience with signed artifact delivery and end-to-end chain-of-custody verification is preferred.
Benefits
- Fully remote work at a 100% remote company.
- Minimum 25 Mbps consumer-grade broadband connection required.
- Up to 5% travel may be required.
- Health, vision, and dental care for employees and their families.
- Flexible vacation policy and generous parental leave.
- Equity package in the form of stock options may be available.
- Career development opportunities and an inclusive, collaborative culture.
About Horizon3 AI
Horizon3 AI builds NodeZero, a proactive security platform that autonomously performs penetration testing and validates attack paths across on‑prem, cloud, and hybrid environments. The company sells its software by subscription to security and IT teams at enterprises and government agencies, helping prioritize and verify fixes. Founded in 2019 and headquartered in San Francisco, it is privately held and serves customers across regulated industries and the public sector.