arXiv:2510.06843cs.CLcs.AI2025-10

用模型自身信号优化多大模型辩论,又快又准。

Self-signals Driven Multi-LLM Debate for Efficient and Accurate Reasoning

  • 利用模型置信度和注意力聚焦自信号动态引导辩论
  • 准确率超越现有方法,同时减少40%以上生成Token数
  • 适合追求高效高精度推理的开发者和研究者

大语言模型在多个领域展现出强大能力。近期研究通过多模型代理辩论(MAD)提升性能,让多个模型迭代讨论并优化答案。然而,现有方法主要依赖外部结构如辩论图或模型评分,忽视了生成过程中产生的自信号(如标记概率和注意力分布)。这导致计算冗余且可能降低性能。本文提出自信号驱动的多大模型辩论(SID),利用两类自信号:模型级置信度与标记级语义聚焦,自适应地引导辩论过程。高置信度模型可提前退出,基于注意力机制压缩冗余内容。我们在多种大模型及多模态大模型上,在多个挑战性基准上评估该方法。实验表明,该方法不仅在准确率上优于现有MAD技术,还显著降低令牌消耗,验证了自信号在提升多代理辩论系统性能与效率方面的有效性。代码将公开于https://github.com/xuhang2019/SID。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have exhibited impressive capabilities across diverse application domains. Recent work has explored Multi-LLM Agent Debate (MAD) as a way to enhance performance by enabling multiple LLMs to discuss and refine responses iteratively. Nevertheless, existing MAD methods predominantly focus on utilizing external structures, such as debate graphs, using LLM-as-a-Judge, while neglecting the application of self signals, such as token logits and attention, that arise during generation. This omission leads to redundant computation and potential performance degradation. In this paper, we shift the focus to the self signals of multi-LLM debate and introduce a Self-Signals Driven Multi-LLM Debate (SID), which leverages two types of self-signals: model-level confidence and token-level semantic focus, to adaptively guide the debate process. Our approach enables high-confidence agents to exit early at the model level and compress the redundant debate contents based on the attention mechanism. We evaluate our method on various LLMs and Multimodal LLMs across multiple challenging benchmarks. Experimental results demonstrate that our method not only outperforms existing MAD techniques in accuracy but also reduces token consumption, highlighting the effectiveness of utilizing self signals in enhancing both the performance and efficiency of multi-agent debate systems. Our code will be available at~\href{https://github.com/xuhang2019/SID}{\texttt{https://github.com/xuhang2019/SID}}.

多模型辩论自信号推理优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。