GrepJob
Baseten

Software Engineer- GPU Fabric Observability

Baseten
Apply
about 3 hours ago
San Francisco, CA, USASenior / Staff+
H1B Sponsor

Base Salary

$200k - $380k/yr

Responsibilities

  • Own Baseten’s GPU fabric observability and root-cause analysis architecture.
  • Build telemetry pipelines across switches, NICs, hosts, GPUs, Kubernetes, and inference services.
  • Model topology, flow paths, service ownership, and failure domains.
  • Separate true fabric faults from host, NIC, GPU, kernel, driver, RDMA, scheduler, and workload failures.
  • Create clear operator workflows for triage, remediation, and post-incident learning.

Requirements

  • Staff-level or senior staff-level experience building production infrastructure software.
  • Strong distributed systems background, especially in streaming systems, telemetry pipelines, diagnostics, or control-plane software.
  • Experience building systems that process high-volume, high-cardinality, noisy operational data.
  • Understanding of networking fundamentals and high-performance networks.
  • Ability to work with low-level infrastructure signals and build practical correlation, anomaly detection, or root-cause analysis systems.

Benefits

  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents.
  • Flexible PTO policy including company-wide Winter Break.
  • Paid parental leave.
  • Fertility and family-building stipend through Carrot.
  • Company-facilitated 401(k).
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Tech Stack

Categories

AI & MLBackendData Engineering