Otter.ai

Software Engineer, AI Agent & LLM

Otter.ai
Apply
3 months ago
Mountain View, CA, USAMid Level
H1B sponsor

Base Salary

$155k - $185k/yr

Responsibilities

  • Build AI-agent experiences for Otter AI Chat that support reasoning over conversations, knowledge retrieval, and complex task completion.
  • Improve the conversational knowledge engine through knowledge extraction, annotation, and indexing.
  • Develop evaluation datasets, automated graders, regression tests, and AI-quality release gates.
  • Diagnose failures across models, prompts, retrieval, tools, data pipelines, backend services, and product workflows.
  • Build shared agent infrastructure for orchestration, tracing, debugging, retries, sandboxed execution, and observability.
  • Improve task completion, correctness, groundedness, reliability, latency, and cost using production traces, customer feedback, and usage signals.
  • Collaborate with AI, product, infrastructure, data, security, and application teams on end-to-end capabilities.

Requirements

  • 3+ years of AI-agent engineering, machine learning engineering, or related experience.
  • Strong backend or distributed-systems engineering skills.
  • Hands-on experience building and shipping AI-agent or LLM-powered products.
  • Experience evaluating nondeterministic systems with a strong focus on AI quality.
  • Ability to use data, traces, logs, and qualitative examples to diagnose and resolve complex failures.
  • Ability to work across services, technical domains, and organizational boundaries.
  • Strong product judgment combined with rigorous engineering and evaluation practices.
  • Ability to take ambiguous problems from exploration through production launch and continuous improvement.
  • Experience using coding agents effectively while rigorously reviewing and controlling their output is a plus.

Benefits

  • Hybrid work arrangement is indicated by #LI-Hybrid.
  • Equal opportunity employer with reasonable accommodations available throughout the hiring process.
Otter.ai

About Otter.ai

201-500 employees

Otter.ai builds an AI meeting assistant that records, transcribes, and summarizes meetings and generates action items for teams and professionals. The subscription-based service offers individual, business, and enterprise plans, with apps for web, mobile, and desktop and integrations with Zoom, Google Meet, and Microsoft Teams. Founded in 2016 and headquartered in Mountain View, California, the company is privately held.

Contact me