Principal Cloud Platform Engineer
SambaNova Systems2 months ago
Base Salary
$144k - $189k/yr
Responsibilities
- Own production inferencing service availability, latency, performance, change management, and capacity planning across regions.
- Automate AI infrastructure deployment in new regions across cloud and on-premises environments.
- Participate in primary and secondary on-call rotations and lead incident response.
- Build monitoring, alerting, and dashboards using Prometheus, Grafana, and Datadog.
- Identify and eliminate performance bottlenecks and design autoscaling policies for variable inference loads.
- Manage infrastructure as code with Terraform and Ansible.
- Build CI/CD pipelines for safely deploying model versions and service updates.
- Forecast infrastructure requirements, manage cloud spending with Finance, and define and report SLOs and SLIs.
Requirements
- Bachelor of Science in Computer Science, Computer Engineering, or a related field.
- At least 5 years of Site Reliability Engineering or DevOps experience.
- Experience supporting large-scale, customer-facing services in a public cloud environment such as AWS, GCP, or Azure.
- Strong programming and scripting skills in Python, Go, Rust, or Java.
- Experience with Docker and Kubernetes.
- Strong knowledge of monitoring and observability tools including Prometheus, Grafana, ELK Stack, and Datadog.
- Experience with Infrastructure as Code tools such as Terraform or CloudFormation.
- Experience with CI/CD tools such as Jenkins, GitHub Actions, or ArgoCD.
- Strong Linux/Unix system administration fundamentals.
- Preferred: experience with hybrid cloud and on-premises infrastructure, production ML/AI inferencing, NVIDIA GPU optimization, vLLM, SGLang, Ray, MLOps, databases, and Redis or Memcached.
Benefits
- US-based full-time employees receive equity and benefits in addition to base salary.
- Employer covers 95% of employee medical insurance premiums and 77% of dependent premiums, with an employer-contributed Health Savings Account.
- Dental, vision, short- and long-term disability, life, AD&D, and Flexible Spending Account options are available.
- Well-being benefits include Headspace, Gympass+, One Medical, counseling, and an Employee Assistance Program.
Tech Stack
Categories
DevOpsSite Reliability
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.