让大模型评判更可靠,自动判断何时该查证、何时该放弃,确保错误率可控。
Judge, Retrieve, or Abstain: Uncertainty-Guarded LLM Judging with Provable Risk Guarantees
- 分两阶段判断:自信时直接评,不自信时检索网页再评
- 通过统计方法确保错误率低于设定值α,且有数学证明
- 适用需要高可信度评估的场景,如评测大型语言模型
使用大模型作为评判者已成为大规模评估模型输出的标准做法,尤其适用于无固定参考答案的主观任务(如帮助性或对齐性评估)。然而,在客观任务中,这种无参考的评判面临可靠性挑战。当缺乏参考答案时,评判者要么依赖模型参数知识,要么通过工具增强获取证据。前者效率高但易幻觉,后者虽能补充证据却增加计算成本,且需可靠机制决定何时何地使用。更重要的是,二者均无法提供接受判决的错误率形式化控制。本文提出一种风险可控框架,基于保留集校准不确定性阈值,使得被接受判决中的误发现率在高概率下低于用户设定的α水平,采用有限样本的Clopper-Pearson区间。当参数模式置信度不足时,实例将被路由至检索增强模式,通过网络检索证据并以第二个校准阈值重新评估。该双重阈值路由机制保持了原有的有限样本保证,无需额外假设。在多个开放域问答基准和不同规模的评判模型上,该框架在维持目标误差率的同时,显著提升了覆盖率,优于单一模式基线。
原文摘要 · Abstract (English)
Using LLMs as judges has become standard practice for evaluating model outputs at scale. This is particularly common for subjective, open-ended tasks such as assessing helpfulness or alignment, where no single reference answer exists. However, objective tasks introduce a distinct reliability challenge for reference-free LLM judging. In the absence of a reference answer, the judge evaluates factual correctness either through its parametric knowledge or through tool augmentation. Although the former enables efficient evaluation, the judge may hallucinate or lack sufficient evidence for its verdict. Conversely, tool augmentation can provide additional evidence but introduces extra computational cost and requires an appropriate mechanism to determine when and how that evidence should be used reliably. More importantly, neither approach alone provides formal control over the risk of accepted verdicts or guarantees their reliability at a specified level. We propose a risk-controlled framework that calibrates uncertainty thresholds on a held-out set so that the false discovery rate among accepted verdicts remains below a user-specified level~$α$ with high probability, using finite-sample Clopper--Pearson intervals. When the parametric mode is not sufficiently confident, the instance is routed to a retrieval-augmented mode, where the judge gathers web evidence and re-evaluates the instance under a second calibrated threshold. The finite-sample guarantee carries over to this two-threshold routing without additional assumptions. Across open-domain QA benchmarks and judges of varying scales, the framework maintains the target error rate while achieving substantially higher coverage than single-mode baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。