2 days ago
Base Salary
$270k - $402k/yr
Responsibilities
- Design and build core Groq platform systems, including APIs, controllers, operators, reconciliation loops, and infrastructure abstractions.
- Write, review, test, debug, and operate substantial production software while providing Senior Staff technical leadership.
- Build production-grade Kubernetes services for dedicated customers running large-scale AI training and inference workloads.
- Apply distributed-systems principles involving partial failure, retries, concurrency, consistency, idempotency, availability, and recovery.
- Design stable platform APIs and contracts that decouple customer experiences from backend infrastructure changes.
- Collaborate across infrastructure, inference, networking, infosec, and other teams to turn ambiguous platform needs into production systems.
Requirements
- Strong experience designing, implementing, testing, shipping, and maintaining production software.
- Deep Kubernetes platform engineering experience with operators, controllers, CRDs, admission control, node lifecycle, cluster services, and production-grade platform design.
- Strong practical distributed-systems expertise, including CAP, consensus, leader election, eventual consistency, state reconciliation, fault domains, and recovery.
- Experience with robust software development lifecycles, including design review, automated testing, staged rollout, rollback, observability, and incident learning.
- Practical experience delivering Kubernetes, cloud infrastructure, or infrastructure control planes as commercially critical or externally consumed products is highly valued but not required.
- Hands-on experience using coding agents such as Codex, Claude Code, or similar systems is highly valued.
- Experience at a hyperscaler or neocloud supporting AI workloads or commercializing GPU clusters, with understanding of large-scale accelerator infrastructure challenges.
- Experience with inference platforms, accelerator or GPU infrastructure, device plugins, cloud infrastructure, or customer-facing platform products.
Benefits
- The role is based in the Dallas, San Francisco, or New York City area.
- Remote work is available while the local Groq office is being established, with an expectation of transitioning onsite once the office opens.
- Groq offers a Long-Term Incentive Program and a robust suite of employee benefits.
Tech Stack
About Groq
Groq designs and operates AI inference hardware and cloud services built around its LPU architecture, aimed at developers and enterprises running large language models and other ML workloads. It generates revenue by selling processors and offering pay-as-you-go inference through its hosted platform and APIs. Founded in 2016 and headquartered in Mountain View, California, the company is privately held.