arXiv:2607.27783cs.CLcs.AI2026-07

通过加权有向无环图整合多个大模型的推理路径,生成可解释的共识推理结果。

Reasoning Consensus: Structural Ensembling of LLM Reasoning via Weighted DAG Aggregation

论文配图:Reasoning Consensus: Structural Ensembling of LLM Reasoning via Weighted DAG Aggregation
图 1 · 摘自论文原文
  • 将多模型推理链转化为有向无环图,按独立支持度加权融合。
  • 在六项基准测试中提升准确率,最高达3.1%(MuSR-MM)。
  • 结果可解释性强,适合需要透明推理过程的高风险任务。

大型语言模型(LLMs)通过思维链探索问题,但这些探索隐藏在非结构化文本中。在高风险任务中,用户无法判断哪些步骤有充分依据、哪些备选方案被认真考虑,或最终结论与被舍弃方案的对比。我们提出一种框架,通过对多个模型的推理结构进行加权合并,构建有向无环图(DAG),实现推理的集成。每个推理步骤的权重基于独立支持该步骤的路径数量,从而输出‘共识推理’。在涵盖法律解释、研究生级科学、叙事多跳推理和一阶逻辑的六个基准上,我们的集成方法优于同等预算的多数投票基线,最大准确率提升3.1%(在MuSR-MM上)。单个模型使用该框架时,在相同推理步数预算下,性能达到甚至超过自洽性方法,并额外提供可检查的共识推理图。集成权重与人工评估的推理质量排名相关性为Spearman ρ=0.30–0.51,且在五项数据集的对比中,共识子图在54.4%–65.4%情况下优于导向多数投票答案的路径。我们还发现该框架可用于分析同一问题的多种推理视角。

原文摘要 · Abstract (English)

Large Language Models (LLMs) explore problems through chain-of-thought, but this exploration is buried in unstructured prose. On high-stakes tasks, users cannot tell which steps are well-supported, which alternatives were seriously considered, or how the final conclusion compares to those the model discarded. We propose a framework that ensembles the reasoning structure, not just the answers, of multiple LLMs by weighted merging of Directed Acyclic Graphs (DAGs) extracted from reasoning chains. We weight each step by how many traces independently attest to it, to return "Consensus Reasoning". Across six benchmarks spanning statutory interpretation, graduate-level science, narrative multi-hop reasoning, and first-order logic, our ensemble outperforms a matched-budget majority-vote baseline, with a maximum accuracy gain of 3.1% on MuSR-MM (narrative multi-hop reasoning). On a single model, the framework matches or exceeds self-consistency at the same trace budget while additionally exposing an inspectable consensus reasoning graph. Ensemble weights correlate with LLM-judge rankings of reasoning quality at Spearman $ρ= 0.30$-$0.51$, and consensus subgraphs are preferred over alternatives leading to the majority-vote answer in 54.4-65.4% of head-to-head comparisons across five of six datasets. We observe that our framework can also be used to analyze diverse reasoning perspectives for a problem.

推理集成可解释性大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。