GrepJob
Harvey

Staff Software Engineer, AI Platform

Harvey
Apply
13 days ago
Toronto, CanadaStaff+

Responsibilities

  • Design and build platform-level systems that enhance Harvey's AI products.
  • Own the infrastructure for model integration, routing, and evaluation.
  • Develop evaluation frameworks and tooling for AI quality improvement.
  • Collaborate with product engineering teams to launch AI products.
  • Prototype and integrate advancements in AI and agentic systems.

Requirements

  • 8+ years of experience in backend systems, with 1+ year in AI/ML engineering.
  • Experience in building and shipping multi-model AI systems in production.
  • Familiarity with context management and session state in AI systems.
  • Proven track record of building internal platforms and SDKs.
  • Strong judgment about design abstractions and developer experience.
  • Excitement about agentic AI and its infrastructure challenges.

Categories