Systems Generalist
Thinking Machines Lab5 hours ago
Base Salary
$300k - $400k/yr
Responsibilities
- Design and build distributed systems for compute orchestration, scheduling, storage, and networking across large GPU and TPU clusters.
- Develop fault-tolerant systems that operate correctly through hardware failures, network partitions, and scaling workloads.
- Build distributed storage and data orchestration layers for large volumes of training and model data.
- Improve collective communication, scheduling, and resource-allocation performance across thousands of machines.
- Partner with research and infrastructure teams to identify bottlenecks and design systems solutions from first principles.
- Write production-quality code and help shape company-wide systems architecture.
Requirements
- At least 5 years of experience building large-scale distributed systems.
- Proficiency in Python and Go, C++, or another systems-level language.
- Strong understanding of consensus, consistency, replication, and fault tolerance.
- Experience with network programming, load balancing, or distributed storage systems.
- Preferred experience with distributed compute or orchestration systems for AI or ML workloads.
- Preferred fluency in containerization, orchestration, and distributed compute frameworks.
- Preferred experience with GPUs, TPUs, and their integration into distributed training or serving systems.
- Background in AI research labs, high-performance computing centers, or similarly demanding environments is preferred.
- Published work or open-source contributions related to distributed systems or performance engineering are preferred.
- Ability to work with high autonomy in a fast-changing, early-stage environment.
Benefits
- Based in San Francisco, California.
- Annual salary range of $300,000-$400,000 USD.
- Visa sponsorship is available for qualifying candidates and roles, with the company committed to working through the visa process.
- Generous health, dental, and vision benefits.
- Unlimited paid time off.
- Paid parental leave.
- Relocation support as needed.
About Thinking Machines Lab
Thinking Machines Lab develops AI and generative AI software and conducts applied research to help organizations make data-driven decisions. The company builds products and data science solutions for enterprise use cases, pairing foundational models with practical tooling and services across industries. It is privately held and headquartered in San Francisco.