Senior Principal Cloud Platform Engineer
SambaNova Systems1 day ago
Bengaluru, IndiaStaff+
Responsibilities
- Own the availability, latency, resource efficiency, change management, emergency response, and regional expansion of the production AI inferencing service.
- Build and maintain monitoring, alerting, and dashboards using Prometheus, Grafana, and Datadog.
- Lead incident response, conduct blameless post-mortems, and automate operational toil.
- Identify performance bottlenecks and design cost-efficient auto-scaling policies for variable inference workloads.
- Manage cloud and on-premise infrastructure as code with Terraform and Ansible.
- Build CI/CD pipelines for deploying model versions and service updates.
- Participate in a shared 24/7 on-call rotation.
Requirements
- Bachelor of Science in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.
- At least 3 years of experience in Site Reliability Engineering, DevOps, or a related role supporting a large-scale customer-facing service in a public cloud environment.
- Strong programming and scripting skills in Python, Go, or Java.
- Production experience with Docker and Kubernetes.
- Deep understanding of monitoring and observability tools such as Prometheus, Grafana, Datadog, or the ELK Stack.
- Experience with infrastructure as code using Terraform or CloudFormation.
- Experience with CI/CD tools such as Jenkins, GitHub Actions, or ArgoCD.
- Strong Linux system administration fundamentals.
- Preferred experience with hybrid cloud and on-premise data center infrastructure.
- Preferred experience supporting production ML or AI inferencing services and optimizing NVIDIA GPU workloads.
- Preferred knowledge of vLLM, SGLang, or Ray and experience managing SQL or NoSQL databases and Redis or Memcached.
Benefits
- Benefits for US-based full-time positions include medical insurance with 95% employee premium coverage and 77% dependent premium coverage, an employer-contributed HSA, dental and vision insurance, disability and life insurance, AD&D coverage, and FSA options.
- Well-being benefits include Headspace, Gympass+ access to physical gyms, One Medical membership, counseling services, and an Employee Assistance Program.
Tech Stack
Categories
DevOpsSite Reliability
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.