用图结构多路径推理,提升复杂事实核查准确率
GraphCheck: Multipath Fact-Checking with Entity-Relationship Graphs
- 将声明转为实体关系图,系统化探索多条推理路径
- 在HOVER和EX-FEVER上准确率超越现有方法,效率高
- 自动选择推理深度,适合不同复杂度的核查任务
自动化事实核查旨在基于相关证据评估文本声明的真实性。然而,需要多跳推理的复杂声明验证仍是重大挑战。我们提出GraphCheck,一种将声明转换为实体-关系图的新框架,实现结构化、系统化的核查。通过显式建模显性和潜在实体,并探索多条推理路径,GraphCheck增强了验证鲁棒性。尽管GraphCheck在复杂场景中表现优异,但对简单声明可能过度复杂。为此,我们引入DP-GraphCheck,采用轻量级策略选择器,动态决定是否直接提示或使用GraphCheck。该机制根据声明复杂度自适应选择推理层级,提升准确率与效率。在HOVER和EX-FEVER数据集上的实验表明,该方法在验证准确率上优于现有模型,且在多路径探索下仍保持高效计算性能。此外,DP-GraphCheck的策略选择机制可泛化至其他核查流程,凸显框架的广泛适用性。
原文摘要 · Abstract (English)
Automated fact-checking aims to assess the truthfulness of textual claims based on relevant evidence. However, verifying complex claims that require multi-hop reasoning remains a significant challenge. We propose GraphCheck, a novel framework that transforms claims into entity-relationship graphs for structured and systematic fact-checking. By explicitly modeling both explicit and latent entities and exploring multiple reasoning paths, GraphCheck enhances verification robustness. While GraphCheck excels in complex scenarios, it may be unnecessarily elaborate for simpler claims. To address this, we introduce DP-GraphCheck, a variant that employs a lightweight strategy selector to choose between direct prompting and GraphCheck adaptively. This selective mechanism improves both accuracy and efficiency by applying the appropriate level of reasoning to each claim. Experiments on the HOVER and EX-FEVER datasets demonstrate that our approach outperforms existing methods in verification accuracy, while achieving strong computational efficiency despite its multipath exploration. Moreover, the strategy selection mechanism in DP-GraphCheck generalizes well to other fact-checking pipelines, highlighting the broad applicability of our framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。