4 months ago
Base Salary
$236k - $290k/yr
Responsibilities
- Design and build scalable, fault-tolerant infrastructure systems across multiple cloud regions.
- Own and evolve multi-cloud infrastructure, including Kubernetes orchestration, networking, and container management.
- Lead observability, incident response, and operational excellence initiatives.
- Architect and optimize distributed systems for reliability, including load balancing, quota management, and failover mechanisms.
- Partner with Product Engineering and Security teams on infrastructure capabilities.
- Drive reproducible and auditable infrastructure-as-code deployments using Terraform and Pulumi.
- Design a model proxy architecture for millions of daily inference requests.
- Build distributed rate limiting and quota management systems using Redis-backed algorithms.
- Architect multi-region deployments that satisfy global data residency requirements.
- Develop observability infrastructure with SLA monitoring, burn-rate alerts, and token attribution for cost tracking.
- Lead improvements to CI/CD pipelines while maintaining production stability.
- Mentor engineers and provide technical leadership through code reviews and design reviews.
Requirements
- 10+ years of production experience in Infrastructure Engineering or Platform Engineering.
- Extensive experience building and scaling complex, large-scale distributed systems.
- Deep proficiency with Azure, with GCP or AWS experience also considered transferable.
- Strong fluency with infrastructure-as-code tools such as Terraform, Pulumi, or CloudFormation.
- Strong understanding of Kubernetes, container orchestration, networking, and cloud security at scale.
- Experience with Datadog, Sentry, PagerDuty, Incident.io, and incident response practices.
- Strong programming skills in Python, Go, or similar languages.
- Preferred experience building infrastructure for AI/ML workloads or high-throughput inference systems.
- Preferred experience with distributed rate limiting, load balancing, quota management, multi-tenant platforms, security, and compliance.
- Track record of leading complex cross-functional projects and delivering measurable impact.
Benefits
- In-person work model in San Francisco, California
- Relocation assistance for new employees
Tech Stack
Categories
About Harvey
Harvey is domain-specific AI for legal and professional services. Adopted by Fortune 500 companies like AT&T, Verizon, Cox, Koch, KKR, Bridgewater, more than 100,000 lawyers across 2,400+ customers in 70 countries and over 75% of AmLaw 100 law firms rely on Harvey to advance legal expertise faster across contract analysis, due diligence, compliance, and litigation. Backed by Sequoia Capital, OpenAI, GV, Kleiner Perkins, Coatue and EQT, Harvey is the trusted partner in modernizing the legal industry.