Software Architect
SambaNova Systems1 month ago
Base Salary
$245k - $325k/yr
Responsibilities
- Own the end-to-end technical architecture of the SambaStack inference platform for scalability, reliability, and performance.
- Define architectural strategy and long-term platform direction across engineering teams.
- Lead design reviews and provide authoritative technical guidance on major capabilities and cross-cutting system changes.
- Identify and resolve systemic performance, reliability, and scaling risks before they affect customers.
- Establish architectural standards, patterns, and best practices across the engineering organization.
- Partner with ML Engineers, Product Managers, QA, and DevOps to turn complex requirements into architectural decisions.
- Mentor Software Engineers and raise team-wide design and engineering quality.
- Evaluate emerging technologies and industry trends and architect new systems for AI inference workloads.
Requirements
- 12+ years of software engineering experience, including significant experience with organization-wide technical influence.
- Proven ownership of large-scale distributed-systems architectures from design through production.
- Expertise building backend systems in Python, Go, or Rust.
- Expert-level Kubernetes knowledge, including Operators, Helm Charts, and cluster-scale resource management.
- Strong understanding of distributed-systems consistency, fault tolerance, observability, and performance at scale.
- Experience setting technical direction across multiple teams and driving cross-functional alignment.
- Excellent written and verbal communication skills for explaining complex architectural decisions to technical and non-technical audiences.
- Track record of mentoring junior engineers and improving engineering quality.
- Preferred: experience with AI inference serving, orchestration, LLM infrastructure, custom hardware accelerators, ML application optimization, cloud-native enterprise platforms, stringent SLA and compliance requirements, AI coding assistants, or AI infrastructure companies.
Benefits
- Base salary range of $245,000–$325,000 USD, plus equity and benefits.
- US-based full-time employees receive 95% medical premium coverage for employees and 77% coverage for dependents, plus an employer-contributed HSA.
- Benefits include dental, vision, short- and long-term disability, basic and voluntary life, AD&D, and flexible spending accounts.
- Well-being benefits include Headspace, Gympass+, One Medical, counseling services, and an Employee Assistance Program.
Tech Stack
Categories
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.