Senior Principal Engineer - SambaRack
SambaNova Systems2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Design and build software components for safe, reliable control, monitoring, and diagnostics of rack-scale AI systems.
- Lead the technical design and implementation of hardware-software integration points and infrastructure services.
- Improve observability, telemetry, diagnostics, performance, scalability, and reliability across the SambaRack platform.
- Identify and resolve performance bottlenecks, reliability gaps, and scaling constraints before they affect customers.
- Collaborate with Hardware Engineering, DevOps, QA, and Product teams to translate infrastructure requirements into technical solutions.
- Help evolve architectural standards, patterns, and best practices across the infrastructure software team.
- Provide technical leadership and mentorship while promoting engineering excellence and systems-level thinking.
- Evaluate emerging technologies and design new systems and capabilities for the AI inference space.
Requirements
- 8–12 years of software engineering experience.
- Strong experience building infrastructure, systems, or platform software.
- Solid programming experience in Go, Rust, Python, or C/C++.
- Strong understanding of Linux, networking, concurrency, and distributed systems.
- Experience designing reliable backend or control-plane services for production systems.
- Experience with hardware management systems such as BMCs, Redfish, IPMI, or OpenBMC.
- Experience with monitoring, telemetry, or observability systems for infrastructure platforms.
- Preferred: experience with rack management, server management, bare-metal infrastructure, fleet management, diagnostics, or hardware health monitoring.
- Preferred: experience with Prometheus, Grafana, and metrics exporter design.
- Preferred: experience supporting enterprise or air-gapped deployments.
- Preferred: understanding of Kubernetes, Helm Charts, and the Kubernetes ecosystem.
- Preferred: experience designing scalable infrastructure and distributed systems.
Benefits
- For US-based full-time employees, the company offers equity and health, dental, vision, disability, life, AD&D, and flexible spending account benefits.
- The company covers 95% of employee medical insurance premiums and 77% of dependent premiums, with an employer-contributed Health Savings Account.
- Well-being benefits include Headspace, Gympass+ access to physical gyms, One Medical, counseling services, and an Employee Assistance Program.
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.