arXiv:2502.09635cs.CLcs.AI2025-02NAACL被引 9

让模型看懂证据背后的上下文和引用,提升事实核查准确率

CORRECT: Context- and Reference-Augmented Reasoning and Prompting for Fact-Checking

  • 构建证据-上下文-引用三层图结构,融合多源信息
  • 在多个数据集上显著超越现有方法,最高提升8.3个百分点
  • 适合需要深度理解文献背景的学术事实核查场景

事实核查通常需对多条证据句进行推理。但证据句常不自包含,需额外上下文与参考文献来理解指代、缩写及研究范围。例如学术论文中的发现需结合原文上下文及被引文献才能准确判断其范围。然而现有模型多聚焦于证据句内部推理,忽略辅助信息。为此,本文提出上下文与引用增强推理与提示方法:构建包含证据、上下文、引用三层的证据图,设计层内与跨层推理以统一生成证据嵌入;针对结论预测,设计证据条件提示编码器,为每条声明生成独特提示嵌入,与声明联合进行事实核查。实验验证了该方法的有效性。

原文摘要 · Abstract (English)

Fact-checking the truthfulness of claims usually requires reasoning over multiple evidence sentences. Oftentimes, evidence sentences may not be always self-contained, and may require additional contexts and references from elsewhere to understand coreferential expressions, acronyms, and the scope of a reported finding. For example, evidence sentences from an academic paper may need contextual sentences in the paper and descriptions in its cited papers to determine the scope of a research discovery. However, most fact-checking models mainly focus on the reasoning within evidence sentences, and ignore the auxiliary contexts and references. To address this problem, we propose a novel method, Context- and Reference-augmented Reasoning and Prompting. For evidence reasoning, we construct a three-layer evidence graph with evidence, context, and reference layers. We design intra- and cross-layer reasoning to integrate three graph layers into a unified evidence embedding. For verdict prediction, we design evidence-conditioned prompt encoder, which produces unique prompt embeddings for each claim. These evidence-conditioned prompt embeddings and claims are unified for fact-checking. Experiments verify the strength of our model.

事实核查多源推理提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。