3 months ago
Base Salary
$135k - $285k/yr
Responsibilities
- Own the reliability of Baseten’s multi-cloud Kubernetes infrastructure, including incident response, post-mortems, and remediation tracking.
- Build and maintain metrics, logging, dashboards, and alerting infrastructure as code.
- Author, validate, and improve runbooks for recurring failure patterns and low-context execution.
- Convert frequent failure patterns into automated mitigations and self-healing automations.
- Diagnose and resolve runtime issues involving latency, memory behavior, GPU utilization, concurrency, and model lifecycle management.
- Define and instrument SLOs and SLIs across customer workloads and internal services.
- Improve SRE practices and build AI-assisted tooling for incident triage and response.
- Work with engineering, forward-deployed, and product teams to improve operational reliability.
Requirements
- Extensive hands-on Kubernetes experience is required; multi-cloud experience with EKS, GKE, or similar is a strong plus.
- Experience building and maintaining scalable infrastructure.
- Strong observability experience across metrics, logging, dashboards, alerting pipelines, and observability-as-code.
- Experience with Terraform, Helm, and GitOps workflows using Flux CD or ArgoCD.
- Experience writing and improving runbooks, leading incident response, and conducting post-mortem analysis.
- Ability to write code while designing effective operational processes, escalation paths, and automation.
- Familiarity with incident.io or a similar incident management platform is a plus.
- Prior ML experience is not required, but curiosity about deploying and serving ML models at scale is advantageous.
Benefits
- Competitive compensation including meaningful equity, with no base-pay amount stated.
- 100% medical, dental, and vision insurance coverage for employees and dependents.
- Flexible PTO and company-wide Winter Break from Christmas Eve through New Year's Day.
- Paid parental leave.
- Fertility and family-building stipend through Carrot.
- Company-facilitated 401(k).
- Exposure to a variety of ML startups and related learning and networking opportunities.
Tech Stack
Categories
DevOpsSite Reliability
About Baseten
Inference is everything. Baseten is an AI infrastructure platform giving you the tooling, expertise, and hardware needed to bring great AI products to market - fast. Our proprietary Inference Stack utilizes the cutting-edge of performance research combined with highly performant and reliable infrastructure to give you out-of-the-box global availability with 99.99% of uptime.