about 1 month ago
New York, NY, USAMid Level / Senior
Base Salary
$175k - $290k/yr
Responsibilities
- Build and improve core systems behind AI agents across various functionalities.
- Design evaluations and experiments to assess agent quality in production.
- Analyze production traces and user behavior to inform product decisions.
- Collaborate with operations and deployed teams to understand workflows.
- Evaluate models and system designs for enterprise tasks.
- Manage the entire process from idea to implementation and iteration.
Requirements
- Strong engineering fundamentals with experience in production systems.
- Fluency in Python programming language.
- Experience with LLM-powered products or applied AI systems.
- An empirical mindset focused on data and real usage.
- Strong understanding of system interactions including retrieval and UX.
- High ownership and comfort in ambiguous situations.
Benefits
- Early-stage equity in the company.
- Competitive, top-of-market salary.
- Catered lunch and dinners.