about 5 hours ago
Base Salary
$197k - $290k/yr
Responsibilities
- Architect the inference pipeline for AI integration.
- Select models and hosting solutions, adapting as needed.
- Build and optimize serving infrastructure for scalability.
- Develop evaluation loops to assess product improvements.
- Manage cost models and track spending per user and feature.
- Define data persistence and summarization strategies.
- Establish safety and privacy standards at the infrastructure level.
Requirements
- Extensive engineering experience with AI systems in production.
- Proficiency in modern LLM serving technologies.
- Experience in building evaluation harnesses for product assessment.
- Ability to construct reliable cloud systems from scratch.
- Strong understanding of cost management in AI inference.
- Hands-on experience with AI tools and workflows.
- Comfortable making decisions with incomplete information.
- Excellent written communication skills for documentation.
- Experience with agent systems and privacy architecture.
Benefits
- Competitive pay and benefits.
- Comprehensive medical, dental, vision, life, and disability insurance.
- 401(k) plan with company matching in the US.
- Flexible PTO and 12 company-wide days off annually.
- Learning and development programs.
- Support for remote work equipment and tools.
- Free Life360 Platinum Membership for your preferred circle.