1 day ago
New York, NY, USA +2 more
Mid Level / Senior
H1B Sponsor
Base Salary
$300k - $405k/yr
Responsibilities
- Own Claude Code's system prompts for each new model snapshot.
- Review production prompt changes and address challenging prompting problems.
- Lead incident response for behavioral and policy concerns.
- Scale prompting and evaluation best practices across teams.
- Deliver product evaluations focused on model behaviors.
- Define and streamline processes for rolling out prompt changes.
- Create model-specific prompt guides documenting optimal strategies.
- Collaborate with product teams to translate feature requirements into effective prompts.
Requirements
- Strong intuition about model capabilities and limitations.
- Ability to thrive in high-intensity environments with fast iteration cycles.
- Experience in creating and maintaining behavioral evaluations.
- Strong technical understanding of agent scaffold architectures and model training processes.
- Proficiency in Python and Typescript.
- Experience driving changes through production systems independently.
- Ability to translate user feedback into coherent prompts and specifications.
- Excellent collaboration skills across organizational boundaries.
- Deep commitment to AI safety and ethical considerations.
Benefits
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Collaborative office space.
Tech Stack
PythonTypeScript
Categories
AI & ML