arXiv:2504.09781cs.CLcs.AI2025-04被引 2

引入裁判模型,让多个推理结果相互验证,提升复杂问答准确性。

Reasoning Court: Combining Reasoning, Action, and Judgment for Multi-Hop Reasoning

  • 用独立裁判模型评估多个推理路径和答案的可信度。
  • 在多跳问答和事实验证任务上超越现有方法,无需微调。
  • 适合需要高可靠性推理的复杂信息整合场景。

尽管大语言模型在问答和事实验证任务中表现出色,但在需要整合多源信息的多跳任务中仍存在幻觉和推理错误。现有方法通过检索增强(基于外部证据)或推理优化(改进提示)来缓解问题,混合策略如ReAct表现更优,但缺乏对中间推理步骤的内部验证,导致错误传播。本文提出新的推理法庭(Reasoning Court, RC)框架,扩展迭代式推理-检索方法,在此基础上引入专用裁判模型。该裁判模型独立评估多个由不同代理生成的候选答案及其推理过程,选择最符合事实且逻辑一致的答案;若所有候选均无效,则结合已有证据与自身知识生成新答案。在多跳问答(HotpotQA、MuSiQue)和事实验证(FEVER)任务上的实验表明,RC在不进行任务特定微调的情况下,持续优于当前最先进的少样本提示方法。

原文摘要 · Abstract (English)

While large language models (LLMs) have demonstrated strong capabilities in tasks like question answering and fact verification, they continue to suffer from hallucinations and reasoning errors, especially in multi-hop tasks that require integration of multiple information sources. Current methods address these issues through retrieval-based techniques (grounding reasoning in external evidence), reasoning-based approaches (enhancing coherence via improved prompting), or hybrid strategies combining both elements. One prominent hybrid method, ReAct, has outperformed purely retrieval-based or reasoning-based approaches; however, it lacks internal verification of intermediate reasoning steps, allowing potential errors to propagate through complex reasoning tasks. In this paper, we introduce Reasoning Court (RC), a novel framework that extends iterative reasoning-and-retrieval methods, such as ReAct, with a dedicated LLM judge. Unlike ReAct, RC employs this judge to independently evaluate multiple candidate answers and their associated reasoning generated by separate LLM agents. The judge is asked to select the answer that it considers the most factually grounded and logically coherent based on the presented reasoning and evidence, or synthesizes a new answer using available evidence and its pre-trained knowledge if all candidates are inadequate, flawed, or invalid. Evaluations on multi-hop benchmarks (HotpotQA, MuSiQue) and fact-verification (FEVER) demonstrate that RC consistently outperforms state-of-the-art few-shot prompting methods without task-specific fine-tuning.

多跳推理推理验证大模型裁判机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。