Judgment Labs
Judgment Labs builds learning and evaluation infrastructure for AI agents, helping engineering teams monitor behavior, surface failure modes, and improve performance from real production traces. Its platform and SDK provide continuous testing, rubrics, and large-scale investigations across tool errors, regressions, and drift. Founded in 2025 and headquartered in San Francisco, the privately held company sells B2B software for teams deploying long‑trajectory agents in development and production environments.
Open Positions at Judgment Labs
4 open positions
Own end-to-end customer engagements for Judgment Labs, deploying and integrating AI-agent monitoring and evaluation infrastructure into production systems. You’ll combine technical implementation, customer partnership, prototyping, and product judgment in a highly autonomous forward-deployed role.
Build the end-to-end product and agent experiences that help teams understand, evaluate, and improve AI agents in production. You’ll own ambiguous problems from customer discovery through implementation and iteration.
Build the full-stack product and agent infrastructure behind Judgment, helping teams investigate, evaluate, and improve AI agents using production evidence. You will own problems end to end, from customer discovery and product definition through implementation and iteration.
Own the backend services, APIs, and data systems that ingest and serve agent telemetry at massive scale. You’ll optimize ClickHouse-based analytics infrastructure while helping build reliable evaluation and monitoring pipelines.