Senior Principal Engineer - SambaRack
SambaNova SystemsResponsibilities
- Design and build software components for safe, reliable control, monitoring, and diagnostics of rack-scale AI systems.
- Lead the technical design and implementation of hardware-software integration points and infrastructure services.
- Improve observability, telemetry, diagnostics, performance, scalability, and reliability across the SambaRack platform.
- Identify and resolve performance bottlenecks, reliability gaps, and scaling constraints before they affect customers.
- Collaborate with Hardware Engineering, DevOps, QA, and Product teams to translate infrastructure requirements into technical solutions.
- Help evolve architectural standards, patterns, and best practices across the infrastructure software team.
- Provide technical leadership and mentorship while promoting engineering excellence and systems-level thinking.
- Evaluate emerging technologies and design new systems and capabilities for the AI inference space.
Requirements
- 8–12 years of software engineering experience.
- Strong experience building infrastructure, systems, or platform software.
- Solid programming experience in Go, Rust, Python, or C/C++.
- Strong understanding of Linux, networking, concurrency, and distributed systems.
- Experience designing reliable backend or control-plane services for production systems.
- Experience with hardware management systems such as BMCs, Redfish, IPMI, or OpenBMC.
- Experience with monitoring, telemetry, or observability systems for infrastructure platforms.
- Preferred: experience with rack management, server management, bare-metal infrastructure, fleet management, diagnostics, or hardware health monitoring.
- Preferred: experience with Prometheus, Grafana, and metrics exporter design.
- Preferred: experience supporting enterprise or air-gapped deployments.
- Preferred: understanding of Kubernetes, Helm Charts, and the Kubernetes ecosystem.
- Preferred: experience designing scalable infrastructure and distributed systems.
Benefits
- For US-based full-time employees, the company offers equity and health, dental, vision, disability, life, AD&D, and flexible spending account benefits.
- The company covers 95% of employee medical insurance premiums and 77% of dependent premiums, with an employer-contributed Health Savings Account.
- Well-being benefits include Headspace, Gympass+ access to physical gyms, One Medical, counseling services, and an Employee Assistance Program.
About SambaNova Systems
Welcome to SambaNova: Revolutionizing AI Capacity At SambaNova, we're empowering developers, enterprises, governments, and data centers to unlock their full AI potential. Our full-stack infrastructure, from chips to models, enables lightning-fast performance, low power consumption, and high-efficiency computing. Our Mission To give every developer, enterprise, government and data center absolute sovereignty over their own data, models and AI infrastructure – to future-proof the AI workloads that will power and scale tomorrow. Our Technology We give our customers the optionality to experience SambaNova through the cloud or on-premise. Samba Cloud delivers the fastest inferences on the largest open source models like Llama 4 and DeepSeek. Developers can get started building in minutes with our OpenAI compatible APIs. All customers start on the developer tier and when they need more capacity can scale into our enterprise tier. SambaStack is our on-premise offering which includes the system, the platform, and foundation models. These components combine into a powerful technology stack that delivers unparalleled performance, ease of use, accuracy, data privacy, and the ability to power every use case across the world's largest organizations. SambaManaged is a modular and ready-to-deploy AI cloud designed to deliver unmatched efficiency for data centers and cloud service providers. This solution allows organizations to quickly deploy advanced AI inference services—without the need for costly infrastructure upgrades or specialized expertise—in as little as 90 days. At the heart of SambaNova innovation is the Reconfigurable Dataflow Unit (RDU). Purpose built for AI workloads, the RDU takes advantage of a dataflow architecture and a three-tiered memory design. The three tiers of memory enable the platform to run hundreds of models on a single node and to switch between them in microseconds. In 2023, SambaNova released its 4th generation RDU chip, the SN40L.