5 hours ago
Base Salary
$270k - $402k/yr
Responsibilities
- Design and build APIs, controllers, operators, reconciliation loops, and infrastructure abstractions for the Groq platform.
- Write, review, test, debug, operate, and maintain substantial production software.
- Build production-grade Kubernetes services for customer AI training and inference workloads.
- Apply distributed-systems principles including handling partial failure, retries, concurrency, consistency, idempotency, availability, and recovery.
- Design stable platform APIs and contracts that decouple customer experiences from backend infrastructure changes.
- Provide Senior Staff technical leadership and collaborate across infrastructure, inference, networking, and infosec teams.
Requirements
- Strong experience designing, implementing, testing, shipping, and maintaining production software.
- Deep Kubernetes platform engineering experience with operators, controllers, CRDs, admission control, node lifecycle, cluster services, and production platform design.
- Strong practical expertise in distributed systems, including CAP, consensus, leader election, eventual consistency, state reconciliation, fault domains, and recovery.
- Experience with infrastructure software development, automated testing, staged rollout, rollback, observability, incident learning, and the software development lifecycle.
- Practical experience delivering Kubernetes, cloud infrastructure, or infrastructure control planes as commercially critical or externally consumed products is valued but not required.
- Substantive hands-on experience using coding agents such as Codex, Claude Code, or similar systems and harnesses is valued.
- Experience at a hyperscaler or neocloud supporting AI workloads or commercializing GPU clusters, with understanding of large-scale accelerator infrastructure challenges.
- Experience with inference platforms, accelerator or GPU infrastructure, device plugins, cloud infrastructure, or customer-facing platform products.
Benefits
- Flexible remote work while the local Groq office is being established, with an expectation of transitioning to onsite work once the office opens.
- Role is based in the Dallas, San Francisco, or New York City area.
- Groq offers a Long-Term Incentive Program and a suite of employee benefits.
- The position includes total cash compensation ranges by level, with potential bonus value incorporated into base pay.
Tech Stack
Categories
About Groq
Groq designs and operates AI inference hardware and cloud services built around its LPU architecture, aimed at developers and enterprises running large language models and other ML workloads. It generates revenue by selling processors and offering pay-as-you-go inference through its hosted platform and APIs. Founded in 2016 and headquartered in Mountain View, California, the company is privately held.