GrepJob
Harvey

Senior Software Engineer, AI Platform

Harvey
Apply
about 2 months ago
New York, NY, USASenior / Staff+

Base Salary

$220k - $300k/yr

Responsibilities

  • Design and build abstractions and platform-level systems for AI products.
  • Own infrastructure for model integration, routing, and evaluation.
  • Build evaluation frameworks and tooling for AI quality improvement.
  • Collaborate with product engineering teams to launch AI products.
  • Evaluate and integrate advancements in AI and agentic systems.

Requirements

  • 5+ years of experience in backend systems, with 1+ year in AI/ML engineering.
  • Experience with multi-model or multi-provider AI systems in production.
  • Familiarity with context management and session state in AI.
  • Track record of building internal platforms or shared infrastructure.
  • Strong judgment about abstractions and good design principles.
  • Excitement about agentic AI and reliability challenges.

Categories