arXiv:2604.09537cs.CLcs.AI2026-04被引 3

构建可依赖证据的模型判断框架,让模型真正根据证据做决策。

Case-Grounded Evidence Verification: A Framework for Constructing Evidence-Sensitive Supervision

  • 通过自动生成支持与非支持样本,实现无需人工标注的证据监督。
  • 模型在有证据时表现显著优于基线,移除或替换证据后性能骤降。
  • 适用于医疗等需严格证据依赖的领域,对模型选择敏感但可跨数据迁移。

证据依赖推理不仅需要将检索文本附加到预测上,更要求模型决策真正依赖于证据是否支持目标命题。实践中常因监督信号弱、证据与命题关联松散、评估不直接测试证据依赖而失败。本文提出案例-接地证据验证框架:模型接收局部案例上下文、外部证据和结构化命题,判断证据是否支持该案例中的命题。核心贡献是自动构建显式支持样本及语义控制的非支持样本(包括反事实错误状态与主题相关负例),无需人工证据标注。在放射科场景中实例化该框架,并训练标准验证器。结果表明,学习到的验证器显著优于仅依赖案例或仅依赖证据的基线,在正确证据下保持强性能,且在移除或替换证据时性能崩溃,证明其真实依赖证据。该行为可迁移至未见证据文章和外部案例分布,但在证据源变化时性能下降,且对主干模型选择敏感。整体表明,证据接地的主要瓶颈不仅是模型能力,更是缺乏编码证据因果作用的监督信号。

原文摘要 · Abstract (English)

Evidence-grounded reasoning requires more than attaching retrieved text to a prediction: a model should make decisions that depend on whether the provided evidence supports the target claim. In practice, this often fails because supervision is weak, evidence is only loosely tied to the claim, and evaluation does not test evidence dependence directly. We introduce case-grounded evidence verification, a general framework in which a model receives a local case context, external evidence, and a structured claim, and must decide whether the evidence supports the claim for that case. Our key contribution is a supervision construction procedure that generates explicit support examples together with semantically controlled non-support examples, including counterfactual wrong-state and topic-related negatives, without manual evidence annotation. We instantiate the framework in radiology and train a standard verifier on the resulting support task. The learned verifier substantially outperforms both case-only and evidence-only baselines, remains strong under correct evidence, and collapses when evidence is removed or swapped, indicating genuine evidence dependence. This behavior transfers across unseen evidence articles and an external case distribution, though performance degrades under evidence-source shift and remains sensitive to backbone choice. Overall, the results suggest that a major bottleneck in evidence grounding is not only model capacity, but the lack of supervision that encodes the causal role of evidence.

证据验证监督学习医疗AI因果推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。