Thinking Machines Lab

Software Engineer, Distributed Systems

Thinking Machines Lab
Apply
2 days ago
San Francisco, CA, USA or New York, NY, USASenior
H1B sponsor

Base Salary

$300k - $400k/yr

Responsibilities

  • Design and build distributed systems for compute orchestration, scheduling, storage, and networking across large GPU and TPU clusters.
  • Develop fault-tolerant systems that continue operating correctly through hardware failures, network partitions, and workload growth.
  • Build distributed storage and data orchestration layers for large volumes of training and model data.
  • Improve collective communication, scheduling, and resource-allocation performance across thousands of machines.
  • Partner with research and infrastructure teams to identify systems bottlenecks and develop first-principles solutions.
  • Write production-quality code and help shape company-wide systems architecture.

Requirements

  • At least 5 years of experience building large-scale distributed systems.
  • Proficiency in Python and Go, C++, or another systems-level language.
  • Strong understanding of consensus, consistency, replication, and fault tolerance.
  • Experience with network programming, load balancing, or distributed storage systems.
  • Preferred: experience building distributed compute or orchestration systems for AI or ML workloads.
  • Preferred: fluency in containerization, orchestration, and distributed compute frameworks.
  • Preferred: experience integrating GPUs or TPUs into distributed training or serving systems.
  • Preferred: background at AI research labs, high-performance computing centers, or similarly demanding environments.
  • Preferred: published work or open-source contributions related to distributed systems or performance engineering.

Benefits

  • Generous health, dental, and vision benefits.
  • Unlimited paid time off and paid parental leave.
  • Relocation support as needed.
  • Based in San Francisco, California, or New York, New York.
  • Annual base salary range of $300,000-$400,000 USD.
  • Visa sponsorship is available, with the company committed to working through the visa process for qualified candidates.

Tech Stack

Categories

Thinking Machines Lab

About Thinking Machines Lab

201-500 employees

Thinking Machines Lab develops AI and generative AI software and conducts applied research to help organizations make data-driven decisions. The company builds products and data science solutions for enterprise use cases, pairing foundational models with practical tooling and services across industries. It is privately held and headquartered in San Francisco.

Contact me