Reducto

Machine Learning Eval Engineer

Reducto
Apply
5 months ago
San Francisco, CA, USAMid Level
H1B Sponsor

Base Salary

$150k - $300k/yr

Responsibilities

  • Design, build, and maintain evaluation benchmarks for Reducto’s models.
  • Develop metrics, heuristics, and workflows to automatically identify failure modes across large real-world datasets.
  • Partner with ML engineers to turn evaluation insights into model improvements and training priorities.
  • Analyze PDFs, spreadsheets, and other difficult document formats to uncover edge cases and hard examples.
  • Build lightweight internal and user-facing tools, including interfaces with Python frameworks such as Flask.
  • Collaborate with customers and internal teams to create bespoke benchmarks based on real-world data needs.

Requirements

  • Strong Python skills and the ability to independently build clean, reliable technical solutions.
  • Comfort working with data infrastructure such as AWS S3 and analytics systems such as Tinybird.
  • Ability to work hands-on with unstructured enterprise data and investigate difficult failure cases.
  • Strong quality, precision, ownership, problem-solving, and cross-functional collaboration skills.
  • Bonus: product thinking, frontend or user-facing interface experience, startup or high-growth company experience, customer-facing experience, or background in AI/ML, data infrastructure, enterprise software, or document understanding systems.

Benefits

  • In-person role at the company’s San Francisco office.
  • Unlimited paid time off.
  • Free daily lunch at the office.
  • Reimbursed transportation.
  • Medical, dental, and vision insurance.
  • Up to $150 per month health and wellness reimbursement.
  • Parental leave with a flexible schedule.

Tech Stack

Categories

Reducto

About Reducto

51-200 employees

Reducto is the complete agentic document platform for leading AI teams needing performance at enterprise scale. We provide a comprehensive toolkit for working with documents the way a human would, combining custom in-house and leading frontier models to power efficient and accurate document workflows. We currently power the best AI teams ranging from startups to Fortune 10 companies across all industries: legal, finance, healthcare, and more. We are built for enterprise workloads with flexible deployment options from the cloud to fully air-gapped environments, SOC II and HIPAA compliance, and zero data retention.