arXiv:2411.01343cs.CL2024-11中稿 · EMNLP被引 5

用抽象语义表示提升事实验证可解释性

AMREx: AMR for Explainable Fact Verification

  • 基于AMR构建可解释的事实验证框架
  • 在FEVER和AVeriTeC上超越基线准确率
  • 支持生成自然语言解释,减少幻觉

随着社交媒体的普及,自动事实验证成为防止虚假信息传播的关键。为同时实现高准确率与可解释性,本文提出AMREx:一种基于抽象语义表示(AMR)的事实验证与解释系统。该系统结合Smatch度量方法,评估语义包含关系与文本相似性,在两个标准数据集FEVER和AVeriTeC上验证有效性。AMREx不仅提升验证准确率,还通过可解释的处理流程返回可追溯的AMR节点映射,辅助生成可信解释。进一步实验表明,利用这些映射可有效引导大模型生成自然语言解释,降低幻觉风险。

原文摘要 · Abstract (English)

With the advent of social media networks and the vast amount of information circulating through them, automatic fact verification is an essential component to prevent the spread of misinformation. It is even more useful to have fact verification systems that provide explanations along with their classifications to ensure accurate predictions. To address both of these requirements, we implement AMREx, an Abstract Meaning Representation (AMR)-based veracity prediction and explanation system for fact verification using a combination of Smatch, an AMR evaluation metric to measure meaning containment and textual similarity, and demonstrate its effectiveness in producing partially explainable justifications using two community standard fact verification datasets, FEVER and AVeriTeC. AMREx surpasses the AVeriTec baseline accuracy showing the effectiveness of our approach for real-world claim verification. It follows an interpretable pipeline and returns an explainable AMR node mapping to clarify the system's veracity predictions when applicable. We further demonstrate that AMREx output can be used to prompt LLMs to generate natural-language explanations using the AMR mappings as a guide to lessen the probability of hallucinations.

事实验证可解释性AMR大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。