Model Behavior Engineer
Notion
6 days ago
New York, NY, USA or San Francisco, CA, USA
Entry Level / Mid Level
H1B Sponsor
Base Salary
$98k - $140k/yr
Responsibilities
- Design, test, and iterate on system prompts and context strategies for AI products.
- Analyze production data to identify issues and translate them into actionable insights.
- Create evaluation strategies and datasets to track quality over time.
- Evaluate and launch new AI models in collaboration with research labs.
- Surface quality priorities and communicate them effectively to engineering and product teams.
- Build tools and systems to enhance AI observability and evaluation.
Requirements
- Demonstrated problem-solving mentality with a bias to action.
- Strong curiosity about AI capabilities and product development.
- Ability to analyze data and find insights from large datasets.
- Excellent communication skills to explain complex issues simply.
- Experience with large language models (LLMs), prompting, or AI products.
Tech Stack
SQL
Categories
AI & MLData Science