Prompt Engineer, Agent Prompts & Evals
Anthropic
23 days ago
New York, NY, USA or San Francisco, CA, USA
Senior
H1B Sponsor
Base Salary
$320k - $405k/yr
Responsibilities
- Design, test, and optimize system and feature-specific prompts for AI behavior.
- Build and maintain evaluation suites to ensure model quality across product updates.
- Collaborate with product and research teams to meet quality and safety standards.
- Support model releases to ensure smooth rollouts and identify regressions.
- Contribute to frameworks and tools for prompt and feature development.
- Mentor product engineers on prompt engineering best practices.
- Adapt quickly in a fast-paced environment with advancing model capabilities.
Requirements
- 5+ years of software engineering experience with Python or similar languages.
- Demonstrated experience with LLMs and prompt engineering.
- Strong understanding of evaluation methodologies and metrics for AI systems.
- Excellent written and verbal communication skills.
- Ability to manage multiple concurrent projects effectively.
- Experience with version control, CI/CD, and modern software development practices.
Benefits
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Collaborative office space.
Tech Stack
Python
Categories
AI & MLData Science