6 months ago
Base Salary
$180k - $300k/yr
Responsibilities
- Own Gamma's LLM and image prompts, continuously improving quality at scale.
- Develop complex prompts for new features using AI JSX.
- Build evaluation frameworks combining quantitative metrics with qualitative feedback.
- Drive the AI roadmap based on quality gaps and evaluate new frontier models.
- Curate datasets for fine-tuning open-source models and launch new modalities.
- Own analytics, tracking, uptime, latency, and cost across Gamma's AI infrastructure.
Requirements
- Proven track record of pushing foundation models to their limits.
- Hands-on experience building and evaluating prompts at scale.
- Proficiency in TypeScript and Python.
- Strong data instincts with experience in writing evals and designing metrics.
- Self-sufficient in gathering and cleaning data for model evaluations.
- Experience with modern LLMs and image models is a plus.
- Familiarity with AI tooling like AI JSX and Braintrust is a plus.