3 hours ago
Palo Alto, CA, USAMid Level / Senior
Base Salary
$200k - $300k/yr
Responsibilities
- Build autonomous agents that complete delegated work end to end.
- Develop evaluations that measure agent accuracy across different tasks.
- Ship agent capabilities in existing user tools with evidence of readiness.
- Investigate production failures and deliver durable, validated fixes.
- Build large-scale failure detection for known and unexpected issues.
- Improve agent recovery when tools or websites fail.
- Create repeatable workflows for measuring whether agent changes improve performance.
Requirements
- Approximately 2 to 11 years of relevant experience, including demonstrated progression in one role.
- Experience building or evaluating production AI or machine learning systems, especially agents or LLM-powered products.
- Strong Python skills.
- Familiarity with Django, React, and TypeScript.
- Experience with evaluation and monitoring tools such as Braintrust or Raindrop is relevant.
- Ability to work across implementation, evaluation, and iteration in a fast-moving environment.
Benefits
- Salary range of $200,000 to $300,000 USD annually.
- Hybrid work arrangement with four days per week in the Palo Alto, California office.
