arXiv:2505.16806cs.CLcs.IR2025-05被引 2

通过双向证据对齐与双门控推理,提升大模型在复杂推理中的准确性和鲁棒性。

Two-way Evidence self-Alignment based Dual-Gated Reasoning Enhancement

  • 双向对齐机制强化因果逻辑理解,避免无关信息干扰。
  • 双门控融合策略在不确定证据下逐步整合模型知识,提升推理精度。
  • 适用于需要高可靠推理的场景,如医疗、法律等专业领域。

大型语言模型(LLMs)在知识密集型多步推理(KIMSR)任务中面临挑战。一是如何有效提取和表示推理依据,现有方法常提取语义相关但逻辑无关的证据,导致推理错误。为此,我们提出双向证据自对齐(TW-ESA)模块,利用严格推理与大模型推理间的相互对齐,增强对证据因果逻辑的理解。二是当证据存在不确定性时,如何结合推理依据与模型内在知识实现准确推理。我们提出双门控推理增强(DGR)模块,逐步融合大模型的有用知识,使模型聚焦于证据中的因果要素,提高鲁棒性。两个模块在统一框架ESA-DGR中联合训练。在三个多样且具有挑战性的KIMSR数据集上的实验表明,ESA-DGR显著优于当前最先进的基于微调的大模型方法,平均准确率(EM)提升4%,F1得分提升5%。代码已公开于https://anonymous.4open.science/r/ESA-DGR-2BF8。

原文摘要 · Abstract (English)

Large language models (LLMs) encounter difficulties in knowledge-intensive multi-step reasoning (KIMSR) tasks. One challenge is how to effectively extract and represent rationale evidence. The current methods often extract semantically relevant but logically irrelevant evidence, resulting in flawed reasoning and inaccurate responses. We propose a two-way evidence self-alignment (TW-ESA) module, which utilizes the mutual alignment between strict reasoning and LLM reasoning to enhance its understanding of the causal logic of evidence, thereby addressing the first challenge. Another challenge is how to utilize the rationale evidence and LLM's intrinsic knowledge for accurate reasoning when the evidence contains uncertainty. We propose a dual-gated reasoning enhancement (DGR) module to gradually fuse useful knowledge of LLM within strict reasoning, which can enable the model to perform accurate reasoning by focusing on causal elements in the evidence and exhibit greater robustness. The two modules are collaboratively trained in a unified framework ESA-DGR. Extensive experiments on three diverse and challenging KIMSR datasets reveal that ESA-DGR significantly surpasses state-of-the-art LLM-based fine-tuning methods, with remarkable average improvements of 4% in exact match (EM) and 5% in F1 score. The implementation code is available at https://anonymous.4open.science/r/ESA-DGR-2BF8.

大模型推理因果推理双门控证据对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。