4 hours ago
Base Salary
$170k - $300k/yr
Responsibilities
- Design and iterate on AI agent behavior across real go-to-market workflows.
- Map manual multi-step workflows into agent-driven flows and take them from prototype through beta to general availability.
- Build evaluations that measure task completion, identify regressions, and expose failure modes.
- Analyze production failures and improve agent robustness, reliability, and safety.
- Build agent harnesses, memory systems, tool infrastructure, retrieval architecture, guardrails, and cross-surface evaluation frameworks.
- Improve agent performance through prompting, tool-use design, context construction, and feedback from production usage and logs.
- Support teams building specialized variants of the managed agent.
Requirements
- Experience building or shipping production systems with LLMs or agents, including areas such as prompting, tool-use design, agent orchestration, retrieval, structured extraction, or fine-tuning.
- Strong backend fundamentals in APIs, databases, and distributed systems.
- Experience designing model or agent evaluations, measuring regressions, or converting qualitative quality questions into measurable signals.
- Ability to debug messy real-world failures and iterate quickly with a systems-and-outcomes mindset.