Base Salary
$184k - $263k/yr
Responsibilities
- Build and improve agent capabilities including memory, context management, and multi-step tool use.
- Design and calibrate evaluation frameworks, including LLM-as-judge systems, to assess agent behavior and improve offline-to-online success.
- Prototype, dogfood, ship, and refine agentic features through rapid feedback loops with real users.
- Debug interactions among models, tools, latency, and other system constraints.
Requirements
- 5+ years of production machine learning experience deploying highly impactful products, or equivalent experience in other roles with a deep ML background.
- Experience rigorously evaluating ML systems by designing metrics, building evaluation pipelines, and aligning judges.
- Ability to develop product intuition through dogfooding and analysis of user behavior.
- Interest and experience in building and evaluating agents, including context handling, multi-step reasoning, and ambiguity at scale.
- Comfort shipping quickly and testing ideas against real-world usage.
Benefits
- The role is based in New York with some in-person meetings and flexibility to work from home.
- Health insurance.
- Six months of paid parental leave.
- 401(k) retirement plan.
- Monthly meal allowance.
- 23 paid days off.
- 13 paid flexible holidays.
- Paid sick leave.
Categories
About Spotify
Deliver creativity to the world -- one note, one voice, one idea at a time. At Spotify, we focus relentlessly on building the best and most valuable experience available anywhere, enhancing every moment by connecting the world to the art and the creatives who shape it. Spotify transformed music listening forever when it launched in Sweden in 2008. Discover, manage and share over 70m tracks for free, or upgrade to Spotify Premium to access exclusive features including offline mode, improved sound quality, and an ad-free music listening experience. Today, Spotify is the most popular global audio streaming service with 365m users, including 165m subscribers across 178 markets. We are the largest driver of revenue to the music business today.