Software Architect
SambaNova SystemsBase Salary
$245k - $325k/yr
Responsibilities
- Own the end-to-end technical architecture of the SambaStack inference platform for scalability, reliability, and performance.
- Define and drive architectural strategy across engineering teams in alignment with product and business objectives.
- Lead design reviews for major capabilities and cross-cutting system changes.
- Identify and resolve systemic performance, reliability, and scaling risks before they affect customers.
- Establish and evolve architectural standards, patterns, and best practices across the engineering organization.
- Partner with ML Engineers, Product Managers, QA, and DevOps to turn complex requirements into architectural decisions.
- Mentor software engineers and develop organization-wide architectural and design capabilities.
- Evaluate emerging technologies and industry trends to inform the technical roadmap.
- Architect new systems, components, and capabilities for AI inference workloads.
Requirements
- 12+ years of software engineering experience, including significant experience with organization-wide technical influence.
- Proven experience owning large-scale distributed-systems architectures from design through production.
- Expertise building backend systems in Python, Go, or Rust.
- Expert-level understanding of Kubernetes, including Operators, Helm Charts, and cluster-scale resource management.
- Strong understanding of distributed-systems principles including consistency, fault tolerance, observability, and performance at scale.
- Experience setting technical direction across multiple teams and driving cross-functional alignment.
- Strong written and verbal communication skills for explaining architectural decisions to technical and non-technical audiences.
- Experience mentoring junior engineers and improving team-wide engineering quality.
- Preferred experience with AI inference serving, orchestration, and production-scale LLM infrastructure.
- Preferred experience designing systems for custom or novel hardware accelerators such as dataflow architectures, GPUs, or TPUs.
- Preferred background in ML application optimization and productionization.
- Preferred experience building cloud-native enterprise platforms with stringent SLA and compliance requirements.
- Familiarity with AI coding assistants and the developer tooling ecosystem is preferred.
- Experience at a high-growth AI infrastructure company is preferred.
Benefits
- US-based full-time employees receive medical insurance with 95% employee premium coverage and 77% dependent premium coverage, plus an employer-contributed HSA.
- Dental, vision, short- and long-term disability, basic and voluntary life, AD&D, and flexible spending account options are provided.
- Well-being benefits include Headspace, Gympass+ membership, One Medical, counseling, and an Employee Assistance Program.
- The role supports SambaNova’s on-premises or cloud-delivered enterprise platform.
About SambaNova Systems
Welcome to SambaNova: Revolutionizing AI Capacity At SambaNova, we're empowering developers, enterprises, governments, and data centers to unlock their full AI potential. Our full-stack infrastructure, from chips to models, enables lightning-fast performance, low power consumption, and high-efficiency computing. Our Mission To give every developer, enterprise, government and data center absolute sovereignty over their own data, models and AI infrastructure – to future-proof the AI workloads that will power and scale tomorrow. Our Technology We give our customers the optionality to experience SambaNova through the cloud or on-premise. Samba Cloud delivers the fastest inferences on the largest open source models like Llama 4 and DeepSeek. Developers can get started building in minutes with our OpenAI compatible APIs. All customers start on the developer tier and when they need more capacity can scale into our enterprise tier. SambaStack is our on-premise offering which includes the system, the platform, and foundation models. These components combine into a powerful technology stack that delivers unparalleled performance, ease of use, accuracy, data privacy, and the ability to power every use case across the world's largest organizations. SambaManaged is a modular and ready-to-deploy AI cloud designed to deliver unmatched efficiency for data centers and cloud service providers. This solution allows organizations to quickly deploy advanced AI inference services—without the need for costly infrastructure upgrades or specialized expertise—in as little as 90 days. At the heart of SambaNova innovation is the Reconfigurable Dataflow Unit (RDU). Purpose built for AI workloads, the RDU takes advantage of a dataflow architecture and a three-tiered memory design. The three tiers of memory enable the platform to run hundreds of models on a single node and to switch between them in microseconds. In 2023, SambaNova released its 4th generation RDU chip, the SN40L.