arXiv:2604.11036cs.CLcs.AI2026-04

用不确定度控制检索,让科学事实核查更可靠。

Uncertainty-Aware Web-Conditioned Scientific Fact-Checking

论文配图:Uncertainty-Aware Web-Conditioned Scientific Fact-Checking
图 1 · 摘自论文原文
  • 将事实拆成原子单元,仅对不确定项触发权威网络搜索
  • 在多个基准上超越现有方法,且仅10%左右事实需外部检索
  • 适合需要可追溯推理、低延迟的高风险科学场景

科学事实核查对生物医学和材料科学等专业领域至关重要,但现有系统常产生幻觉或推理不一致,尤其在证据片段有限、资源受限时。本文提出一种基于原子谓词-论元分解与校准不确定度门控验证的流水线:原子事实通过嵌入对齐局部证据,由小型证据驱动检查器验证,仅当支持不确定时才触发领域限定的权威网络搜索。系统支持二值(支持/驳回)和三值(支持/驳回/未知)分类。在仅上下文(无网络)与上下文+网络(不确定度门控检索)两种模式下评估;当检索证据与上下文冲突时,系统选择弃权(NEI)而非覆盖上下文。实验表明,该框架在多个基准上优于最强基线。平均仅有少数原子事实触发网络检索,说明外部证据被选择性调用而非例行使用。结合原子粒度与校准不确定度门控验证,实现更可解释、上下文感知的核查,适用于需可追溯推理、可控成本与延迟的高风险单文档场景。

原文摘要 · Abstract (English)

Scientific fact-checking is vital for assessing claims in specialized domains such as biomedicine and materials science, yet existing systems often hallucinate or apply inconsistent reasoning, especially when verifying technical, compositional claims against an evidence snippet under source and cost/latency constraints. We present a pipeline centered on atomic predicate-argument decomposition and calibrated, uncertainty-gated corroboration: atomic facts are aligned to local snippets via embeddings, verified by a compact evidence-grounded checker, and only facts with uncertain support trigger domain-restricted web search over authoritative sources. The system supports both binary and tri-valued classification where it predicts labels from Supported, Refuted, NEI for three-way tasks. We evaluate under two regimes, Context-Only (no web) and Context+Web (uncertainty-gated web corroboration); when retrieved evidence conflicts with the provided context, we abstain with NEI rather than overriding the context. On multiple benchmarks, our framework surpasses the strongest benchmarks. In our experiments, web corroboration was invoked for only a minority of atomic facts on average, indicating that external evidence is consulted selectively under calibrated uncertainty rather than routinely. Overall, coupling atomic granularity with calibrated, uncertainty-gated corroboration yields more interpretable and context-conditioned verification, making the approach well-suited to high-stakes, single-document settings that demand traceable rationales, predictable cost/latency, and conservative.

科学核查不确定性原子分解权威检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。