SambaNova Systems

Principal Cloud Backend Engineer

SambaNova Systems

Apply
3 months ago
Palo Alto, CA, USA
Staff+
H1B Sponsor

Responsibilities

  • Lead the technical vision and architecture for the inference serving and monetization platform.
  • Design systems that are fault-tolerant, highly available, and scalable for accurate usage tracking.
  • Architect core systems for flexible monetization, including entitlements and quota management.
  • Build reliable systems for usage metering and prepare data for billing.
  • Design APIs for seamless integration with external billing and payment providers.
  • Implement complex distributed systems for real-time rate limiting and quota enforcement.
  • Identify and eliminate bottlenecks to ensure low-latency request handling.
  • Establish best practices in code quality, testing, and observability.
  • Collaborate with Product Management, Finance, and GTM teams to develop scalable technical solutions.

Requirements

  • 10+ years of experience in software engineering with a focus on large-scale distributed backend systems.
  • 5+ years in a Principal or Lead Engineer role with a track record of architecting business-critical platforms.
  • Expert proficiency in Go, Rust, or C++ with a deep understanding of concurrency and performance optimization.
  • Hands-on experience with cloud-native technologies and major cloud providers.
  • Extensive experience with SQL and NoSQL databases and designing data models for high-throughput applications.
  • Strong foundation in API design and building resilient microservices.
  • Excellent communication and leadership skills to drive technical consensus.

Benefits

  • 95% premium coverage for employee medical insurance and 77% for dependents.
  • Health Savings Account (HSA) with employer contribution.
  • Dental, Vision, Short/Long term Disability, Basic Life, and Voluntary Life insurance plans.
  • Flexible Spending Account (FSA) options for health care and dependent care.
  • Well-being benefits including a subscription to Headspace and Gympass+ membership.

Tech Stack

AWSAzureC++DockerGoGoogle Cloud PlatformgRPCKubernetesPostgreSQLRedisRust

Categories

AI & MLBackendData EngineeringDevOps