Groq

Staff Networking Platform Engineer, Infrastructure

Groq
Apply
3 days ago

Base Salary

$270k - $402k/yr

Responsibilities

  • Translate customer connectivity, isolation, access, and performance needs into supported networking platform capabilities.
  • Build Kubernetes-native automation for tenant and node network provisioning, scaling, repair, replacement, reassignment, and cleanup.
  • Own dynamic routing, BGP, VLANs, overlays, IP allocation, service exposure, ingress, egress, VIPs, load balancers, and public IPs across management, tenant, and external networks.
  • Operate Kubernetes networking for the Groq management plane and tenant clusters, including Cilium, network policy, service routing, and bare-metal integration.
  • Automate GPU networking lifecycle operations for NVL72 systems, InfiniBand, RoCE, and GPUDirect.
  • Manage network inventory and fabric integration through IPAM, NetBox, Netris, UFM, and related APIs.
  • Define and verify tenant isolation, segmentation, traffic policy, access controls, and network security boundaries.
  • Establish declarative configuration, GitOps reconciliation, testing, staged rollout, drift detection, and recovery procedures.
  • Own network telemetry, troubleshooting, incident remediation, and reliability improvements for production services.

Requirements

  • Deep production experience designing and operating data center networking services through deployment, expansion, maintenance, and incidents.
  • Strong understanding of TCP/IP, BGP, routing policy, peering, ECMP, segmentation, interconnects, packet paths, and failure behavior.
  • Experience with leaf-spine fabrics, underlay and overlay networks, VLANs, VRFs, and EVPN/VXLAN.
  • Practical Kubernetes and Linux networking experience, including CNI behavior, Cilium or comparable systems, network policy, and service exposure.
  • Experience building Kubernetes controllers, operators, and custom resources in Go, with safe retries, reconciliation, partial-failure handling, and cleanup.
  • Experience with network automation, API integrations, version control, code review, automated testing, controlled rollout, and GitOps workflows.
  • Experience delivering multitenant infrastructure or managed Kubernetes networking products through onboarding, provisioning, upgrades, scaling, and production support.
  • Experience designing tenant separation, management network boundaries, traffic controls, and methods to verify network security controls.
  • Experience with fabric management and IPAM systems such as Netris, UFM, and NetBox.
  • Experience with NVIDIA GPU infrastructure and AI networking, including InfiniBand, Spectrum-X, NVL72 systems, RDMA, RoCE, and congestion control.
  • Experience networking large GPU clusters, including distributed workload performance, high-bandwidth east-west traffic, and multi-site connectivity.
  • Ability to translate customer requirements into reliable, supportable networking capabilities with defined behavior and operational procedures.

Benefits

  • Role is based in the Dallas, San Francisco, or New York City area.
  • Remote work is available while the company establishes a local Groq office, with an expected transition to onsite work once the office opens.
  • Groq offers employee benefits and a Long-Term Incentive (LTI) Program.
  • The role offers mission-driven work on complex networking, Kubernetes, data center, and GPU infrastructure challenges.

Categories

Groq

About Groq

201-500 employees

Groq designs and operates AI inference hardware and cloud services built around its LPU architecture, aimed at developers and enterprises running large language models and other ML workloads. It generates revenue by selling processors and offering pay-as-you-go inference through its hosted platform and APIs. Founded in 2016 and headquartered in Mountain View, California, the company is privately held.

Contact me