Harvey

Staff Software Engineer, Backend Platform

Harvey
Apply
8 months ago
San Francisco, CA, USA or New York, NY, USAStaff+
H1B Sponsor

Base Salary

$238k - $290k/yr

Responsibilities

  • Develop and maintain internal backend frameworks and libraries for API routing, service lifecycle management, caching, messaging, and error handling.
  • Create APIs, service templates, and versioned interfaces that establish consistent patterns for services and features.
  • Improve platform performance and scalability through asynchronous I/O, streaming data processing, and modern backend architecture patterns.
  • Design domain-specific abstractions for authorization, streaming, data governance, event processing, retrieval, context handling, and prompt lifecycle management.
  • Build tracing, metrics, and automated testing into the platform to improve reliability and observability.
  • Support GenAI-native workloads including high-throughput model inference and streaming or long-running API interactions.
  • Collaborate with model infrastructure, developer experience, infrastructure, and product engineering teams to integrate platform components and promote best practices.

Requirements

  • 7+ years of software engineering experience post-BS/MS, including scalable backend systems or internal developer platforms.
  • Bachelor’s or master’s degree implied by the requirement for experience post-BS/MS.
  • Proficiency in Python or similar languages and deep knowledge of APIs, data stores, concurrency, and distributed systems.
  • Hands-on experience with web frameworks and service architectures such as Flask, FastAPI, bounded context services, or microservices, plus versioned API design.
  • Familiarity with Redis, Kafka, SQL/NoSQL databases, vector databases, caching, and messaging technologies.
  • Experience writing high-quality, well-tested code using unit and integration testing, static typing, and CI.
  • Strong problem-solving, developer experience, collaboration, and communication skills.
  • Experience contributing to or maintaining internal libraries or frameworks is preferred.

Tech Stack

Apache KafkaFastAPIFlaskPythonRedisSQL

Categories

Harvey

About Harvey

501-1,000 employees

Harvey is domain-specific AI for legal and professional services. Adopted by Fortune 500 companies like AT&T, Verizon, Cox, Koch, KKR, Bridgewater, more than 100,000 lawyers across 2,400+ customers in 70 countries and over 75% of AmLaw 100 law firms rely on Harvey to advance legal expertise faster across contract analysis, due diligence, compliance, and litigation. Backed by Sequoia Capital, OpenAI, GV, Kleiner Perkins, Coatue and EQT, Harvey is the trusted partner in modernizing the legal industry.