Elicit

Model Behavior Engineer, Reasoning and Decision Making

Elicit
Apply
3 hours ago
Remote, United States or Oakland, CA, USASenior / Staff+

Base Salary

$185k - $320k/yr

Responsibilities

  • Understand user and domain-expert decision problems, including objectives, constraints, evidence, and unknowns.
  • Define and measure good reasoning through evaluations combining example inspection, expert judgment, and quantitative analysis.
  • Investigate model and agent failures, develop testable improvement hypotheses, and experiment with decomposition, context, tools, information seeking, and self-checking.
  • Design reliable software abstractions, data structures, and component boundaries for reasoning workflows and evaluations.
  • Write maintainable code, participate in design and code reviews, test and monitor changes, and integrate systems into the product.
  • Design agent environments and representations for evidence, assumptions, unresolved questions, and decision-making processes.

Requirements

  • Demonstrated rigorous thinking about ambiguous problems, hidden assumptions, conflicting evidence, and uncertainty.
  • Curiosity across domains and ability to learn from specialists and communicate with people of different expertise.
  • Strong experimental judgment, including designing evaluations without established benchmarks and distinguishing meaningful evidence from noise.
  • Ability to independently write and debug code, work with data and model APIs, and take experiments into maintained codebases.
  • Comfort with Python or a comparable programming language.
  • Practical familiarity with language models and their capabilities and limitations.
  • Strong software design and architectural judgment, including experience building understandable and extensible systems.
  • Effective use of coding assistants while taking responsibility for design understanding and verification.
  • Evidence of substantial projects, thoughtful experiments, and clear explanations of technical decisions is valued.

Benefits

  • Flexible work from the Oakland office or remotely, with travel for quarterly retreats and coworking events.
  • Fully covered health, dental, vision, and life insurance for the employee, with family coverage and FSA/HSA options.
  • Flexible vacation policy with a recommended minimum of 20 days per year and company holidays.
  • $200 monthly wellbeing stipend.
  • 401(k) with a 6% employer match.
  • New Mac plus a $1,000 first-year workstation or home-office budget and $500 annually thereafter.
  • $1,000 quarterly AI experimentation and learning budget.
  • Team administrative assistant support.
  • Equity is offered for all roles, with employee-friendly equity terms.

Tech Stack

Categories

Elicit

About Elicit

51-200 employees

Elicit builds an AI research assistant that automates literature review tasks such as paper summarization, data extraction, and evidence synthesis for scientists, analysts, and decision-makers. It offers a SaaS platform with enterprise contracts and single-tenant deployments, used for high-stakes evidence synthesis in sectors including pharma. Founded in 2023 and headquartered in Oakland, CA, the privately held public benefit company emphasizes reliable, scalable infrastructure for large language model workloads.

Contact me