Baseten

Software Engineer, Networking (Agent Infra)

Baseten
Apply
8 hours ago
San Francisco, CA, USA or New York, NY, USASenior
H1B sponsor

Base Salary

$160k - $330k/yr

Responsibilities

  • Design and build a user-space, VPP-based data plane connecting microVM sandboxes to one another, Baseten services, and the internet.
  • Build multi-tenant virtual private networking and EVPN, GENEVE, and VXLAN overlays across regions.
  • Expose networking capabilities through a programmable API for the rest of the platform.
  • Improve latency and connection scale for agent-to-agent and agent-to-service traffic.
  • Build regional routing that directs requests to nearby regions and preserves connections across sandbox suspension and resumption.
  • Build secure sandbox ingress and egress, including firewalling, static egress IPs, custom domains, and managed TLS.
  • Build L7 proxies for request inspection, filtering, secret injection, and auditing.
  • Own per-sandbox addressing, including IPv6, and network isolation between tenants.
  • Build packet-path observability across guest, host, and network layers and debug production issues end to end.
  • Collaborate with compute, storage, GPU infrastructure, and datacenter teams.

Requirements

  • Production experience with user-space packet processing such as DPDK or VPP, or with virtualized network functions such as VNF/NFV.
  • Production experience building multi-tenant networking using technologies such as VXLAN, GENEVE, or VRF.
  • Experience building a software-defined network, overlay network, or packet-processing data plane in production.
  • Strong production systems programming skills in Rust, Go, and/or C/C++; network architects must be hands-on builders rather than only configurators.
  • Experience building cloud networking as a provider rather than only consuming a cloud provider’s network.
  • Strong grounding in TCP/IP and routing.
  • Experience building or operating proxies, load balancers, or L4/L7 gateways at scale.
  • Experience debugging latency and throughput problems using packet captures, tracing, and profiling.
  • Preferred experience with VPP/FD.io, GENEVE or VXLAN overlays, EVPN, Linux kernel networking, eBPF/XDP, netfilter or nftables, network namespaces, virtual machine networking, IPv6, multi-region routing, anycast, BGP, TLS termination, DNS, or egress security controls.
  • Preferred background in telecom user-plane or 5G core networking, or low-latency trading networks.

Benefits

  • Competitive compensation including meaningful equity.
  • For U.S. employees, 100% medical, dental, and vision insurance coverage for employees and dependents.
  • Flexible paid time off and a company-wide Winter Break from Christmas Eve through New Year’s Day.
  • Paid parental leave.
  • Fertility and family-building stipend through Carrot.
  • For U.S. employees, a company-facilitated 401(k).
  • Exposure to a variety of ML startups and related learning and networking opportunities.

Tech Stack

Categories

Baseten

About Baseten

201-500 employees

Baseten builds an AI inference platform that provides tooling, infrastructure, and hardware to deploy, scale, and serve machine-learning models in production. The company sells managed model serving and developer tooling to software teams at AI product companies, with customers including Notion, Abridge, Writer, and Cursor. Privately held and headquartered in San Francisco, it focuses on high-availability, globally distributed inference for production workloads.

Contact me