通过自我反思机制提升多跳事实验证的推理准确性。
ReflectFact: Self-Reflective Agents for Improving Comprehension and Reasoning in Multi-Hop Fact Verification

- 引入自省式代理框架,分三步规划、校验与重构推理路径。
- 在HOVER和EX-FEVER上分别超越最强基线3.32%和2.78%。
- 适合需要高可信度事实验证的应用场景,如社交媒体辟谣。
多跳事实验证需基于多份证据推理判断声明真伪,对遏制社交媒体谣言至关重要,但依然极具挑战。现有方法主要依赖多代理协作分解任务,但仍存在两大缺陷:(1) 代理缺乏全局目标意识,导致推理偏离方向;(2) 参数化知识与证据冲突,削弱基于证据的推理并引发误判。为此,我们提出ReflectFact——一种新型自省式代理框架。该框架引入三项关键任务:显式推理路径规划通过实体补全、子问题分解与结论整合构建证据支撑路径;证据漂移验证在代理仅复述先验知识时要求其引用支持证据,以校准偏差;推理反思验证则从全局视角重新审视每一步推理,发现不一致即重生成,修正位置偏见与替换偏见。最终,代理聚合验证后的推理链输出可靠结论。在HOVER和EX-FEVER上的实验表明,ReflectFact有效修复了现有方法的理解与推理缺陷,达到当前最优性能,分别领先最强基线3.32%和2.78%。
原文摘要 · Abstract (English)
Multi-hop fact verification, which verifies claims by reasoning over multiple pieces of evidence, is critical for combating misinformation on social media yet remains highly challenging. Recent methods primarily rely on multi-agent collaboration to decompose fact verification into specialized subtasks. However, these methods face two critical limitations: (1) agents may perform individual subtasks without sufficient awareness of the global verification objective, causing their reasoning to deviate from the intended direction; and (2) conflicts between parametric knowledge and the provided evidence may undermine evidence-grounded reasoning and lead to incorrect verdicts. To address these challenges, we propose ReflectFact, a novel self-reflective agent framework for multi-hop fact verification. ReflectFact introduces three key tasks. Explicit Reasoning Path Planning builds an evidence-grounded reasoning path by resolving implicit entities, decomposing the claim into sub-questions, and integrating the verified facts into a verdict. Evidence-Drift Verification makes the agent re-answer by quoting the supporting evidence when a grounded answer merely echoes its parametric prior, thereby calibrating evidence deviation to ensure grounded comprehension. Reasoning Reflection Verification re-examines each reasoning step and regenerates it once an inconsistency is detected, correcting reasoning flaws such as location bias and replacement bias through a global task perspective. Subsequently, the agent aggregates validated reasoning chains to yield reliable verdicts. Extensive experiments on HOVER and EX-FEVER demonstrate that ReflectFact effectively remedies the comprehension and reasoning defects of existing methods, achieving state-of-the-art performance and respectively outperforming the strongest baseline by 3.32\% and 2.78\% on the two datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。