arXiv:2509.11035cs.AIcs.CR2025-09ACL被引 20

无需共识的多智能体辩论框架,提升推理准确率并降低计算开销。

Free-MAD: Consensus-Free Multi-Agent Debate

论文配图:Free-MAD: Consensus-Free Multi-Agent Debate
图 1 · 摘自论文原文
  • 采用基于轨迹的评分机制,不依赖最后一轮投票
  • 单轮辩论即可达成优于多轮共识的方法,性能提升显著
  • 引入反从众机制,增强对错误引导的鲁棒性,适合高可靠性场景

多智能体辩论(MAD)是提升大语言模型推理能力的新方法。现有MAD方法依赖多轮交互达成共识,最终通过最后一轮多数投票决定结果。但该设计存在三方面局限:多轮通信增加令牌开销,限制可扩展性;大语言模型固有的从众倾向导致正确回答被错误观点干扰,引发错误传播;多数投票引入随机性与不公平,削弱推理表现。为此,我们提出 extsc{Free-MAD},一种无需共识的新型MAD框架。该框架引入基于轨迹的评分机制,评估整个辩论过程而非仅最后一轮。该机制追踪各代理推理演变,实现更精准公平的决策。同时, extsc{Free-MAD}通过引入反从众机制重构辩论阶段,缓解多数意见的过度影响。在八个基准数据集上的实验表明, extsc{Free-MAD}仅需单轮辩论即显著提升推理性能,大幅降低令牌消耗。此外,在真实攻击场景下,其表现优于现有MAD方法,具备更强鲁棒性。

原文摘要 · Abstract (English)

Multi-agent debate (MAD) is an emerging approach to improving the reasoning capabilities of large language models (LLMs). Existing MAD methods rely on multiple rounds of interaction among agents to reach consensus, and the final output is selected by majority voting in the last round. However, this consensus-based design faces several limitations. First, multiple rounds of communication increases token overhead and limits scalability. Second, due to the inherent conformity of LLMs, agents that initially produce correct responses may be influenced by incorrect ones during the debate process, causing error propagation. Third, majority voting introduces randomness and unfairness in the decision-making phase, and can degrade the reasoning performance. To address these issues, we propose \textsc{Free-MAD}, a novel MAD framework that eliminates the need for consensus among agents. \textsc{Free-MAD} introduces a novel score-based decision mechanism that evaluates the entire debate trajectory rather than relying on the last round only. This mechanism tracks how each agent's reasoning evolves, enabling more accurate and fair outcomes. In addition, \textsc{Free-MAD} reconstructs the debate phase by introducing anti-conformity, a mechanism that enables agents to mitigate excessive influence from the majority. Experiments on eight benchmark datasets demonstrate that \textsc{Free-MAD} significantly improves reasoning performance while requiring only a single-round debate and thus reducing token costs. We also show that compared to existing MAD approaches, \textsc{Free-MAD} exhibits improved robustness in real-world attack scenarios.

多智能体推理增强对话系统大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。