Principal Cloud Backend Engineer
SambaNova Systems
3 months ago
Palo Alto, CA, USA
Staff+
H1B Sponsor
Responsibilities
- Lead the technical vision and architecture for the inference serving and monetization platform.
- Design systems that are fault-tolerant, highly available, and scalable for accurate usage tracking.
- Architect core systems for flexible monetization, including entitlements and quota management.
- Build reliable systems for usage metering and prepare data for billing.
- Design APIs for seamless integration with external billing and payment providers.
- Implement complex distributed systems for real-time rate limiting and quota enforcement.
- Identify and eliminate bottlenecks to ensure low-latency request handling.
- Establish best practices in code quality, testing, and observability.
- Collaborate with Product Management, Finance, and GTM teams to develop scalable technical solutions.
Requirements
- 10+ years of experience in software engineering with a focus on large-scale distributed backend systems.
- 5+ years in a Principal or Lead Engineer role with a track record of architecting business-critical platforms.
- Expert proficiency in Go, Rust, or C++ with a deep understanding of concurrency and performance optimization.
- Hands-on experience with cloud-native technologies and major cloud providers.
- Extensive experience with SQL and NoSQL databases and designing data models for high-throughput applications.
- Strong foundation in API design and building resilient microservices.
- Excellent communication and leadership skills to drive technical consensus.
Benefits
- 95% premium coverage for employee medical insurance and 77% for dependents.
- Health Savings Account (HSA) with employer contribution.
- Dental, Vision, Short/Long term Disability, Basic Life, and Voluntary Life insurance plans.
- Flexible Spending Account (FSA) options for health care and dependent care.
- Well-being benefits including a subscription to Headspace and Gympass+ membership.
Tech Stack
AWSAzureC++DockerGoGoogle Cloud PlatformgRPCKubernetesPostgreSQLRedisRust
Categories
AI & MLBackendData EngineeringDevOps