Software Architect - SambaStack
SambaNova Systems2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Own the end-to-end technical architecture of the SambaStack inference platform for scalability, reliability, and performance.
- Define and drive architectural strategy across engineering teams in alignment with product and business objectives.
- Lead design reviews for major capabilities and cross-cutting system changes while providing authoritative technical guidance.
- Identify and resolve systemic risks such as performance bottlenecks, reliability gaps, and scaling constraints.
- Establish architectural standards, patterns, and best practices across the engineering organization.
- Partner with ML Engineers, Product Managers, QA, and DevOps to translate complex requirements into architectural decisions.
- Mentor Software Engineers and improve organization-wide architectural thinking and engineering quality.
- Evaluate emerging technologies and industry trends and architect new systems for AI inference workloads.
Requirements
- 12+ years of software engineering experience, including significant experience with organization-wide technical influence.
- Proven ownership of large-scale distributed systems architectures from design through production.
- Expertise building backend systems in Python, Go, or Rust.
- Expert-level understanding of Kubernetes, including Operators, Helm Charts, and cluster-scale resource management.
- Strong understanding of distributed systems principles including consistency, fault tolerance, observability, and performance at scale.
- Experience setting technical direction across multiple teams and driving cross-functional alignment.
- Excellent written and verbal communication skills for explaining architectural decisions to technical and non-technical audiences.
- Track record of mentoring junior engineers and elevating team-wide engineering quality.
- Preferred: familiarity with AI inference serving, orchestration, production-scale LLM infrastructure, custom hardware accelerators such as dataflow architectures, GPUs, or TPUs, ML application optimization, enterprise cloud-native platforms, stringent SLA and compliance requirements, AI coding assistants, and high-growth AI infrastructure companies.
Benefits
- Base salary range of ₹10,300,000–₹12,500,000 INR.
- US-based full-time benefits include employer coverage of 95% of employee medical insurance premiums and 77% of dependent premiums, plus an employer-contributed Health Savings Account.
- Dental, vision, short- and long-term disability, basic and voluntary life, AD&D, and flexible spending account options are available.
- Well-being benefits include Headspace, Gympass+ with access to physical gyms, One Medical, counseling, and an Employee Assistance Program.
- The total rewards package includes equity and benefits in addition to base salary.
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.