Groq

Staff/Sr. Staff Forward Deployed Engineer

Groq
Apply
2 months ago
Worth, IL, USA +2 moreStaff+
H1B sponsor

Base Salary

$270k - $402k/yr

Responsibilities

  • Own technical execution across customer engagements from discovery and architecture through proofs of concept, deployment, validation, production readiness, and handoff.
  • Translate ambiguous customer requirements into architectures, implementation plans, test criteria, runbooks, and engineering actions.
  • Work hands-on across Linux, bare-metal infrastructure, Kubernetes, Slurm, networking, storage, observability, automation, and Groq platform integrations.
  • Support large-scale GPU and LPX deployments through infrastructure bring-up, cluster validation, workload testing, benchmarking, failure isolation, and acceptance testing.
  • Reason about AI training and inference workloads, including concurrency, throughput, latency, data movement, caching, scheduling, and infrastructure bottlenecks.
  • Lead customer discovery, architecture reviews, demonstrations, and proofs of concept while explaining technical tradeoffs and performance results.
  • Troubleshoot production and pre-production issues across organizational and technical boundaries while maintaining end-to-end ownership.
  • Build reusable automation, reference architectures, test suites, deployment patterns, documentation, and lessons learned.
  • Bring customer feedback and field evidence to Product and Engineering to improve repeatable platform capabilities.

Requirements

  • At least 4 years of hands-on experience building, deploying, operating, or troubleshooting cloud infrastructure, AI infrastructure, HPC systems, large-scale platforms, or similar production environments.
  • Strong Linux and distributed-systems fundamentals with practical experience in Kubernetes, Slurm, bare-metal environments, or comparable infrastructure platforms.
  • Technical depth in at least one area such as GPU or accelerator systems, networking, storage, orchestration/platform engineering, or infrastructure reliability.
  • Working knowledge of AI training and inference workloads and their effects on compute, networking, storage, scheduling, latency, and throughput.
  • Strong Python, Go, Bash, or equivalent programming and scripting skills for diagnostics, automation, deployment tooling, testing, or integrations.
  • Demonstrated experience personally debugging and delivering systems rather than operating only at the architecture, project-management, or escalation level.
  • Ability to decompose ambiguous problems, drive issues to resolution across multiple teams, and communicate technical tradeoffs clearly to customers and stakeholders.
  • Preferred experience includes NVIDIA GPU infrastructure, CUDA, NCCL, NVLink/NVSwitch, DCGM, GPU Operator, InfiniBand, RoCE, Kubernetes, or Slurm.
  • Preferred experience includes multi-node GPU cluster bring-up, health checks, stress testing, collective-communication testing, benchmarking, and acceptance criteria.
  • Preferred experience includes high-performance storage systems, infrastructure automation and lifecycle tooling, customer-facing networking or security, and technical proofs of concept or reference architectures.

Benefits

  • Remote flexibility is available while the local office is established, with an expected transition to onsite work once the office opens.
  • The role is based in the Dallas, San Francisco, or New York City area.
  • Groq offers a Long-Term Incentive Program and a robust suite of employee benefits.
  • The compensation package uses a Total Cash philosophy and may include potential bonus value in base pay.

Categories

Forward Deployed
Groq

About Groq

201-500 employees

Groq designs and operates AI inference hardware and cloud services built around its LPU architecture, aimed at developers and enterprises running large language models and other ML workloads. It generates revenue by selling processors and offering pay-as-you-go inference through its hosted platform and APIs. Founded in 2016 and headquartered in Mountain View, California, the company is privately held.

Contact me