19 hours ago
Base Salary
$185k - $250k/yr
Responsibilities
- Lead the acquisition, allocation, deployment, maintenance, and lifecycle management of specialized TPU pod fleets.
- Architect TPU cluster infrastructure, including pod slicing, topology planning, and deployment strategies for Google’s TPU platforms.
- Build scalable multi-cloud capacity-management systems to migrate workloads across TPU regions and pod configurations.
- Develop automated operators to identify, cordon, and repair unhealthy TPU pods.
- Execute workload migrations and deployment drains while meeting regional and compliance requirements.
- Model ROI and unit economics across TPU, GPU, and other accelerator options.
- Partner with Model Performance, SRE, Infrastructure, FDE, leadership, and Google Cloud teams to tune workloads and deliver infrastructure changes.
- Lead capacity-crunch incident response by reallocating and re-coordinating TPU workloads during outages.
Requirements
- Bachelor’s, Master’s, or Ph.D. degree in Computer Science, Engineering, Mathematics, or a related field.
- At least 5 years of professional experience in a high-growth environment, preferably at a hyperscaler or specialized accelerator provider.
- Hands-on experience with Google Cloud TPUs, including pod slicing, ICI topology, JAX/XLA, TPU scheduling, and fault handling.
- Deep Kubernetes expertise, including taints, cordons, node draining, and custom operators.
- Production-level experience with Go or Python.
- Strong financial literacy and ability to model capacity reliability and cost trade-offs.
- Experience with additional non-NVIDIA accelerators such as AWS Trainium/Inferentia with Neuron SDK or AMD Instinct with ROCm is preferred.
- Familiarity with multi-accelerator scheduling, cost/performance modeling, and accelerator-specific workload optimization is preferred.
- High tenacity and a collaborative mindset.
Benefits
- Competitive compensation including meaningful equity.
- 100% medical, dental, and vision insurance coverage for employees and dependents.
- Flexible PTO and a company-wide Winter Break from Christmas Eve through New Year’s Day.
- Paid parental leave.
- Fertility and family-building stipend through Carrot.
- Company-facilitated 401(k).
- Exposure to a variety of ML startups and related learning and networking opportunities.
Tech Stack
Categories
About Baseten
Baseten builds an AI inference platform that provides tooling, infrastructure, and hardware to deploy, scale, and serve machine-learning models in production. The company sells managed model serving and developer tooling to software teams at AI product companies, with customers including Notion, Abridge, Writer, and Cursor. Privately held and headquartered in San Francisco, it focuses on high-availability, globally distributed inference for production workloads.