28 days ago
Base Salary
$270k - $402k/yr
Responsibilities
- Design and build core Groq platform systems, including APIs, controllers, operators, reconciliation loops, and infrastructure abstractions.
- Write, review, test, debug, and operate substantial production software while providing Senior Staff technical leadership.
- Build production-grade Kubernetes services for dedicated customers running large-scale AI training and inference workloads.
- Apply distributed-systems principles involving partial failure, retries, concurrency, consistency, idempotency, availability, and recovery.
- Design stable platform APIs and contracts that decouple customer experiences from backend infrastructure changes.
- Collaborate across infrastructure, inference, networking, information security, and other teams to turn ambiguous platform needs into production systems.
Requirements
- Strong experience designing, implementing, testing, shipping, and maintaining production software.
- Deep Kubernetes platform engineering experience with operators, controllers, CRDs, admission control, node lifecycle, cluster services, and production-grade platform design.
- Strong practical expertise in distributed systems, including CAP, consensus, leader election, eventual consistency, state reconciliation, fault domains, and recovery.
- Experience with software design reviews, automated testing, staged rollouts, rollbacks, observability, incident learning, and the broader software development lifecycle.
- Experience delivering Kubernetes, cloud infrastructure, or infrastructure control planes as commercially critical or externally consumed products is highly valued but not required.
- Hands-on experience using coding agents such as Codex, Claude Code, or similar systems or harnesses is highly valued.
- Experience at a hyperscaler or neocloud supporting AI workloads or commercializing GPU clusters is valued.
- Experience with inference platforms, accelerator or GPU infrastructure, device plugins, cloud infrastructure, or customer-facing platform products.
- Ability to work comfortably with ambiguity and provide technical leadership.
Benefits
- Competitive total cash compensation is described as inclusive of potential bonus value, with additional Long-Term Incentive and employee benefits programs.
- The role is based in the Dallas, San Francisco, or New York City area; remote work is available while the local Groq office is established, with an expectation of transitioning onsite once the office opens.
Tech Stack
About Groq
Groq designs and operates AI inference hardware and cloud services built around its LPU architecture, aimed at developers and enterprises running large language models and other ML workloads. It generates revenue by selling processors and offering pay-as-you-go inference through its hosted platform and APIs. Founded in 2016 and headquartered in Mountain View, California, the company is privately held.
