Staff Software Engineer, GPU Infrastructure Lifecycle Management
Together AIabout 5 hours ago
Base Salary
$240k - $280k/yr
Responsibilities
- Design and implement the provisioning state machine for GPU infrastructure.
- Create a self-service API for the inference team to manage clusters with a single API call.
- Automate self-healing processes for degraded or failed nodes.
- Ensure reliability of the provisioning pipeline through idempotency and drift detection.
- Collaborate with the inference/ML platform team to encode cluster requirements.
- Apply strong software engineering practices including testing and CI/CD.
Requirements
- Strong software engineering background in Go, Python, Rust, or similar.
- Experience with durable workflow orchestration tools like Temporal or Cadence.
- Proven ability to build software control planes or orchestration systems.
- Familiarity with event-driven systems and message queues.
- A product mindset with experience in building internal platforms or APIs.
Benefits
- Competitive compensation and startup equity.
- Health insurance and other competitive benefits.