arXiv:2607.20950cs.LG2026-07

提出新方法在部分验证下优化模型输出选择,提升医疗视觉问答效果。

Best-of-Evidence: Best-of-N Selection under Partial Verification

论文配图:Best-of-Evidence: Best-of-N Selection under Partial Verification
图 1 · 摘自论文原文
  • 构建可复用主张的带符号图结构,支持部分验证下的候选选择
  • 在四个医疗VQA任务中实现比原方法更高的准确率,最高提升8.2%
  • 适合需要可信证据但无法全响应验证的场景,如医学诊断辅助

BoN通过采样多个候选并基于代理分数选择最优结果来提升模型输出,但其假设完整候选可被可靠评估。在许多视觉语言任务中,仅部分信息(如发现、片段、数值、区域或关系)可验证,而整体响应无法获得可信验证器。此外,同一主张可能在不同候选中呈现对立立场,导致一个观察结果同时支持和反驳不同候选。本文提出最佳证据(Best-of-Evidence, BoE),一种推理时的选择框架:保持候选池固定,用带符号的候选-因子图表示可复用主张,并在有限预算内分配证据操作以改变最终选择。BoE形式化了部分验证下的选择机制,提供基于分数的控制器;零预算情形下恢复原始BoN决策。理论上证明残余证据容量限制了证据驱动的改进,且共享因子查询可在因子码模型中实现O(log K)与Θ(K)的查询复杂度分离。在四个医疗视觉问答设置上的实验表明,当证据可靠、对比性强且与决策相关时,BoE能改进固定池选择并挽回部分BoN失败案例,同时也揭示了信道质量与候选生成能力对普遍增益的制约。

原文摘要 · Abstract (English)

BoN improves model outputs by sampling several candidates and selecting one with a proxy score, but it assumes that complete candidates can be evaluated reliably. Many vision-language tasks instead provide only partial verification: a finding, span, value, region, or relation may be checkable even when no dependable whole-response verifier exists. Moreover, the same claim may recur across candidates with opposing stances, allowing one observation to support part of the pool and contradict another. We introduce Best-of-Evidence (BoE), an inference-time selection framework that keeps the BoN candidate pool fixed, represents reusable claims with a signed candidate--factor graph, and allocates a limited budget to evidence actions that can change the final choice. BoE formalizes selection under partial verification and provides a practical score-based controller, with the zero-budget case recovering the underlying BoN decision. Theoretically, we show that residual evidence capacity limits any evidence-driven improvement and that shared factor queries can achieve an O(log K) versus Θ(K) query separation in a factor-code model. Common-ledger experiments on four medical VQA settings show that BoE can improve fixed-pool selection and rescue some BoN failures when evidence is reliable, contrastive, and decision-relevant, while also revealing the channel-quality and candidate-generation limits that prevent universal gains.

视觉问答证据推理模型选择医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。