Harvey

Senior Software Engineer, Production Engineering

Harvey
Apply
2 months ago

Base Salary

$161k - $242k/yr

Responsibilities

  • Design, build, and operate production infrastructure supporting Harvey’s products and AI workloads.
  • Drive technical direction across compute infrastructure, networking, Kubernetes, workflow orchestration, and production operations.
  • Lead cross-functional initiatives improving reliability, scalability, security, operational efficiency, and infrastructure cost.
  • Partner with Product Engineering, Security, AI Infrastructure, and Platform teams on resilient infrastructure solutions.
  • Establish reusable patterns, tooling, and paved paths for safely shipping and operating production services.
  • Build and operate global compute and network infrastructure for high availability, scalability, reliability, and performance.
  • Develop capacity models, demand forecasts, and fleet lifecycle automation.
  • Operate and improve the Kubernetes platform, including provisioning, upgrades, networking, monitoring, reliability, performance, and automation.
  • Improve infrastructure cost efficiency through capacity management, rightsizing, workload optimization, and utilization monitoring.
  • Build secure infrastructure foundations covering identity and access management, network isolation, secrets management, auditing, and compliance controls.
  • Develop Infrastructure-as-Code and automation frameworks using Terraform and Pulumi.
  • Improve observability, monitoring, alerting, incident response, and operational readiness.
  • Participate in on-call rotation, lead incident response when needed, and implement durable improvements from production learnings.
  • Conduct design reviews, document technical decisions, maintain operational rigor, and mentor engineers.

Requirements

  • At least 5 years of software, infrastructure, site reliability, or production engineering experience.
  • Deep experience building and operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform.
  • Strong hands-on experience operating Kubernetes in production, including cluster lifecycle management, networking, and reliability.
  • Experience building and operating distributed systems with strong reliability, scalability, and performance characteristics.
  • Experience with infrastructure automation and Infrastructure-as-Code using Terraform or Pulumi.
  • Strong understanding of compute infrastructure, networking, capacity planning, fleet management, and production operations.
  • Experience designing and operating observability systems, including monitoring, logging, alerting, and incident response.
  • Strong understanding of infrastructure security, including IAM, network security, secrets management, and compliance practices.
  • Experience driving complex cross-functional technical initiatives and influencing engineering decisions without formal authority.
  • Excellent communication skills and ability to explain technical concepts clearly.
  • Preferred experience supporting AI/ML or LLM infrastructure at scale.
  • Preferred experience operating GPU fleets, high-performance computing infrastructure, or large-scale capacity planning.
  • Preferred experience with multi-cloud or hybrid cloud environments.
  • Preferred experience building internal platforms or developer tooling that improves engineering velocity and production safety.

Benefits

  • Equal opportunity employer with reasonable accommodations available.
  • Salary range of $161,300-$241,900 USD depending on location.
  • Participation in an on-call rotation is required.
  • Applicant privacy notices may apply depending on location.

Categories

DevOpsSite Reliability
Harvey

About Harvey

1,001-5,000 employees

Harvey builds domain-specific generative AI for legal and other professional services, delivered as an enterprise platform and APIs to automate contract analysis, due diligence, compliance, and litigation workflows. Founded in 2022 and headquartered in San Francisco, it sells to law firms and corporate legal departments on enterprise agreements; investors include Sequoia Capital and OpenAI. Customers include multiple Am Law 100 firms and Fortune 500 companies’ legal teams.

Contact me