5 months ago
Base Salary
$135k - $285k/yr
Responsibilities
- Own the reliability of Baseten’s multi-cloud Kubernetes infrastructure, including incident response, post-mortems, and remediation tracking.
- Build and maintain metrics, logging, dashboards, and alerting infrastructure as code.
- Author, validate, and improve runbooks for recurring failure patterns and low-context execution.
- Convert frequent failure patterns into automated mitigations and self-healing automations.
- Diagnose and resolve runtime issues involving latency, memory behavior, GPU utilization, concurrency, and model lifecycle management.
- Define and instrument SLOs and SLIs across customer workloads and internal services.
- Improve SRE practices and build AI-assisted tooling for incident triage and response.
- Work with engineering, forward-deployed, and product teams to improve operational reliability.
Requirements
- Extensive hands-on Kubernetes experience is required; multi-cloud experience with EKS, GKE, or similar is a strong plus.
- Experience building and maintaining scalable infrastructure.
- Strong observability experience across metrics, logging, dashboards, alerting pipelines, and observability-as-code.
- Experience with Terraform, Helm, and GitOps workflows using Flux CD or ArgoCD.
- Experience writing and improving runbooks, leading incident response, and conducting post-mortem analysis.
- Ability to write code while designing effective operational processes, escalation paths, and automation.
- Familiarity with incident.io or a similar incident management platform is a plus.
- Prior ML experience is not required, but curiosity about deploying and serving ML models at scale is advantageous.
Benefits
- Competitive compensation including meaningful equity, with no base-pay amount stated.
- 100% medical, dental, and vision insurance coverage for employees and dependents.
- Flexible PTO and company-wide Winter Break from Christmas Eve through New Year's Day.
- Paid parental leave.
- Fertility and family-building stipend through Carrot.
- Company-facilitated 401(k).
- Exposure to a variety of ML startups and related learning and networking opportunities.
Tech Stack
Categories
DevOpsSite Reliability
About Baseten
Baseten builds an AI inference platform that provides tooling, infrastructure, and hardware to deploy, scale, and serve machine-learning models in production. The company sells managed model serving and developer tooling to software teams at AI product companies, with customers including Notion, Abridge, Writer, and Cursor. Privately held and headquartered in San Francisco, it focuses on high-availability, globally distributed inference for production workloads.