Litera

LLM Ops Engineer

Litera
Apply
10 hours ago
Denver, CO, USAMid Level
H1B sponsor

Base Salary

$105k - $130k/yr

Responsibilities

  • Build and operate a scalable AI platform for accessing and deploying models across multiple providers and environments.
  • Ensure high availability and resiliency through intelligent routing, failover strategies, and production-grade infrastructure.
  • Secure AI operations by protecting model access, safeguarding sensitive data, and enforcing governance standards.
  • Create unified APIs, self-service capabilities, tooling, and best practices for developers.
  • Optimize AI platform performance, reliability, and cost efficiency through monitoring, analytics, and provider strategy management.
  • Evaluate emerging technologies and lead the evolution of AI operations capabilities.
  • Provide dashboards, alerting, quality monitoring, and service-level metrics for operational excellence.
  • Implement testing frameworks, quality controls, and production-readiness standards for AI solutions.

Requirements

  • At least 3 years of experience in DevOps, platform engineering, MLOps, or a related field, including hands-on experience operating LLMs in production.
  • Experience deploying, managing, and scaling models across multiple AI providers, including OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, or Google Vertex AI.
  • Strong expertise in highly available and secure infrastructure, including load balancing, failover strategies, secrets management, and access controls.
  • Experience with API management, gateway technologies, and production-grade AI service operations.
  • Strong Python programming skills and experience developing and supporting scalable systems.
  • Ability to solve complex technical challenges and collaborate across teams in a fast-paced, evolving environment.
  • Preferred experience with fine-tuning or training large language models for domain-specific applications.
  • Preferred familiarity with Kubeflow, MLflow, Apache Airflow, LLM evaluation frameworks, retrieval-augmented generation, vector databases, inference optimization, infrastructure-as-code, Kubernetes, compliance frameworks, or AI cost optimization.

Benefits

  • Hybrid work arrangement in Denver, Colorado, with an expectation of at least three days per week in the office.
  • Base salary of $105,000 to $130,000 USD for Colorado applicants.
  • Eligibility to participate in a company bonus plan.
  • Medical, dental, and vision coverage, a 401(k) with company match, and incentive and recognition programs, subject to eligibility requirements.
  • Opportunities for global collaboration, career development, and meaningful stretch assignments.

Tech Stack

Apache AirflowKubernetesMLflowPython
Litera

About Litera

501-1,000 employees

Litera is trusted Legal AI that best unifies the practice and business of law, built on 30 years of legal expertise that no AI startup can shortcut, and engineered for the decades ahead. The company combines purpose-built legal technology with Lito, its award-winning Legal AI agent, to Raise The Bar™ for the legal profession worldwide. With AI solutions spanning legal drafting, document comparison, contract review, knowledge management, business development, and more, Litera serves over 15,000 global customers and 2.3 million daily users, including 99% of the AmLaw 100. Integrated directly into Microsoft 365 and Google Workspace across devices, Litera delivers the right data, in the right place, at the right time - reducing context-switching so lawyers can practice law, not manage tools, while winning more business, driving efficiency and the deeper client relationships that fuel sustainable growth. For more information, visit litera.com or follow us on LinkedIn.

Contact me