Upstart

Principal Engineer, LLM

Upstart
Apply
1 day ago
Remote, United StatesStaff+
H1B sponsor

Base Salary

$238k - $330k/yr

Responsibilities

  • Rapidly prototype ambiguous initiatives across agent platforms, multi-agent context sharing, borrower-facing assistants, and borrower-connected internal workflows.
  • Design production LLM architectures involving structured outputs, tool calling, context engineering, retrieval and memory patterns, state management, and multi-agent orchestration.
  • Create golden datasets, automated evaluation harnesses, regression gates, failure-mode analyses, latency benchmarks, cost benchmarks, and architectural blueprints for production handoffs.
  • Partner with product, design, operations, engineering leadership, and receiving squad technical leads from initial spikes through productionization.
  • Design reliable non-deterministic user experiences with appropriate latency budgets, fallback paths, guardrails, observability, and trust considerations.
  • Make pragmatic decisions about prompting, deterministic guardrails, model routing, fine-tuning, and distillation based on latency, cost, and reliability.
  • Model agentic coding and verification practices and help product squads adopt higher-leverage AI-native engineering workflows.

Requirements

  • 8+ years of software engineering experience and hands-on experience shipping non-deterministic, user-facing LLM or AI products.
  • Deep practical experience designing production LLM systems with structured outputs, tool calling, context engineering, retrieval or memory patterns, and multi-step or multi-agent orchestration.
  • Strong distributed-systems and backend fundamentals, including asynchronous orchestration, streaming user experiences, caching, timeouts, fallback paths, rate-limit handling, and end-to-end observability or tracing.
  • Experience building golden datasets, automated evaluation harnesses, deterministic checks, heuristics, LLM-as-a-judge evaluations, regression gates, and systematic failure-mode analyses.
  • Experience applying safety guardrails, deterministic logic, prompting, context engineering, and protections against hallucinations and prompt or data risks.
  • Full-stack prototyping fluency across backend and frontend stacks, such as Python and TypeScript/React.
  • Experience aligning with partner squads, handing off ownership cleanly, and working directly with product, design, operations, and business leaders.
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or equivalent practical experience.
  • Preferred: experience in startup or 0-to-1 environments, agent platforms or reusable orchestration abstractions, production fine-tuning or distillation, AI-native engineering workflows, and regulated or high-trust consumer domains.

Benefits

  • Remote position available across the United States, with East/West Coast time-zone requirements.
  • Most work can be completed remotely, with most teams meeting in person once or twice per quarter for 2–4 consecutive days.
  • Base salary range is $238,400–$330,200 USD, with target bonuses, equity compensation, and benefits.
  • Medical, dental, vision, wellness resources, health savings account contributions, life insurance, and disability coverage are available.
  • 401(k) or Group Retirement Savings Plan with a company match of $2 for every $1 contributed, up to $15,000 annually in the US and CAD equivalent in Canada.
  • Employee Stock Purchase Plan, paid time off, sick leave, company holidays, paid family and parental leave, and family-centered caregiving benefits are provided.
  • Employee Assistance Program, financial wellness resources, annual wellness allowance, and annual productivity allowance are included.
  • Team events, employee resource groups, catered office lunches, and stocked micro-kitchens are available where applicable.
Upstart

About Upstart

1,001-5,000 employees

Upstart builds an AI-powered lending marketplace and cloud software that connect consumers to banks and credit unions for personal, auto, and home-equity credit. Lenders use Upstart’s credit models and applications to automate originations, while Upstart earns platform and referral fees. Founded in 2012 and headquartered in San Mateo, California, Upstart is a public company listed on NASDAQ under the ticker UPST.

Contact me