4 hours ago
Remote, WorldwideSenior
Responsibilities
- Build evaluation systems that define and measure agent output quality across multiple marketing channels.
- Design scalable feedback loops that help agents learn from real-world results and performance signals.
- Own agent architecture, model strategy, and the data pipelines powering the agents.
- Work closely with the founder to shape the product's agent architecture and learning systems.
- Hire and lead the AI team as the organization grows.
Requirements
- At least 3 years of experience building production machine learning or AI systems.
- Recent hands-on experience shipping LLM products or agents.
- Experience designing evaluations and learning from outcome signals at scale, including in search, ranking, or recommendation systems.
- Strong TypeScript skills, including Next.js, and Python proficiency for data analysis, evaluations, and model work.
- Ability to ship end to end and turn judgments about output quality into measurable, actionable standards.
- Ownership experience in a startup or small-team environment.
- Search or ranking experience involving search engines or AI answer engines is valuable.
- Experience at a leading AI research organization or strong research program is beneficial.
- Familiarity with marketing, growth, or content products is beneficial.