Principal Cloud Platform Engineer
SambaNova SystemsBase Salary
$144k - $189k/yr
Responsibilities
- Own production inferencing service availability, latency, performance, change management, and capacity planning across regions.
- Automate AI infrastructure deployment in new regions across cloud and on-premises environments.
- Participate in primary and secondary on-call rotations and lead incident response.
- Build monitoring, alerting, and dashboards using Prometheus, Grafana, and Datadog.
- Identify and eliminate performance bottlenecks and design autoscaling policies for variable inference loads.
- Manage infrastructure as code with Terraform and Ansible.
- Build CI/CD pipelines for safely deploying model versions and service updates.
- Forecast infrastructure requirements, manage cloud spending with Finance, and define and report SLOs and SLIs.
Requirements
- Bachelor of Science in Computer Science, Computer Engineering, or a related field.
- At least 5 years of Site Reliability Engineering or DevOps experience.
- Experience supporting large-scale, customer-facing services in a public cloud environment such as AWS, GCP, or Azure.
- Strong programming and scripting skills in Python, Go, Rust, or Java.
- Experience with Docker and Kubernetes.
- Strong knowledge of monitoring and observability tools including Prometheus, Grafana, ELK Stack, and Datadog.
- Experience with Infrastructure as Code tools such as Terraform or CloudFormation.
- Experience with CI/CD tools such as Jenkins, GitHub Actions, or ArgoCD.
- Strong Linux/Unix system administration fundamentals.
- Preferred: experience with hybrid cloud and on-premises infrastructure, production ML/AI inferencing, NVIDIA GPU optimization, vLLM, SGLang, Ray, MLOps, databases, and Redis or Memcached.
Benefits
- US-based full-time employees receive equity and benefits in addition to base salary.
- Employer covers 95% of employee medical insurance premiums and 77% of dependent premiums, with an employer-contributed Health Savings Account.
- Dental, vision, short- and long-term disability, life, AD&D, and Flexible Spending Account options are available.
- Well-being benefits include Headspace, Gympass+, One Medical, counseling, and an Employee Assistance Program.
Tech Stack
Categories
About SambaNova Systems
Welcome to SambaNova: Revolutionizing AI Capacity At SambaNova, we're empowering developers, enterprises, governments, and data centers to unlock their full AI potential. Our full-stack infrastructure, from chips to models, enables lightning-fast performance, low power consumption, and high-efficiency computing. Our Mission To give every developer, enterprise, government and data center absolute sovereignty over their own data, models and AI infrastructure – to future-proof the AI workloads that will power and scale tomorrow. Our Technology We give our customers the optionality to experience SambaNova through the cloud or on-premise. Samba Cloud delivers the fastest inferences on the largest open source models like Llama 4 and DeepSeek. Developers can get started building in minutes with our OpenAI compatible APIs. All customers start on the developer tier and when they need more capacity can scale into our enterprise tier. SambaStack is our on-premise offering which includes the system, the platform, and foundation models. These components combine into a powerful technology stack that delivers unparalleled performance, ease of use, accuracy, data privacy, and the ability to power every use case across the world's largest organizations. SambaManaged is a modular and ready-to-deploy AI cloud designed to deliver unmatched efficiency for data centers and cloud service providers. This solution allows organizations to quickly deploy advanced AI inference services—without the need for costly infrastructure upgrades or specialized expertise—in as little as 90 days. At the heart of SambaNova innovation is the Reconfigurable Dataflow Unit (RDU). Purpose built for AI workloads, the RDU takes advantage of a dataflow architecture and a three-tiered memory design. The three tiers of memory enable the platform to run hundreds of models on a single node and to switch between them in microseconds. In 2023, SambaNova released its 4th generation RDU chip, the SN40L.