GrepJob
Upstart

Principal Engineer, LLM (Platform and Tooling)

Upstart
Apply
about 3 hours ago
Remote, Worldwide
Staff+
H1B Sponsor

Base Salary

$238k - $330k/yr

Responsibilities

  • Define and drive the multi-year technical roadmap for the Core GenAI Platform.
  • Collaborate with leadership to influence business strategy with technical insights.
  • Lead architecture and design of large-scale systems for model inference and compliance.
  • Identify and solve systemic technical risks impacting AI initiatives.
  • Represent Upstart as a thought leader in GenAI systems.
  • Establish operational standards for GenAI integrations.
  • Build platform components to accelerate engineer productivity.
  • Mentor senior engineers and shape future technical leaders.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or Mathematics, or equivalent experience with 8 years in the field.
  • Deep expertise in LLM-specific infrastructure and inference optimization.
  • Ability to design scalable RAG architectures and manage model lifecycles.
  • Experience building automated evaluation pipelines for model accuracy and safety.
  • Hands-on experience with LLM toolchains like LangChain or OpenAI APIs.
  • Experience designing ML/LLM platforms at scale, optimizing for cost and reliability.
  • Expertise in best practices for GenAI, including fairness and data privacy.

Benefits

  • Competitive compensation with base pay, bonuses, and equity grants.
  • Generous 401(k) plan with matching contributions.
  • Employee Stock Purchase Plan with discounted stock options.
  • Affordable medical, dental, and vision coverage with high employer contribution.
  • Paid time off, sick leave, and company holidays.
  • Paid family and parental leave.
  • Employee Assistance Program offering mental health support.
  • Annual wellness and productivity allowances.
  • Connection through team events and community initiatives.

Tech Stack

DockerFastAPIKotlinKubernetesPythonReactTerraformTypeScript

Categories

AI & MLBackendFull Stack