单模型实现动态辩论,提速3.7倍且省87%计算量
Mixture of Debaters: Learn to Debate at Architectural Level in Multi-Agent Reasoning

- 用专家混合架构让模型自动生成辩论角色和流程
- 在多模态任务上准确率超单模型与传统多代理系统
- 适合需要高效推理的智能系统开发者
现有多代理辩论框架存在两大缺陷:架构固定,角色与协作模式无法动态调整;需复制多个模型实例,带来巨大计算开销。本文提出混合辩论者(Mixture of Debaters, MoD),通过专家混合(MoE)范式,在单一模型内实现动态自我辩论。针对辩证推理适配MoE的三个关键挑战:(1) 双重路由机制解耦角色分配与流程控制,动态决定何时辩论、何时整合;(2) 动量切换机制利用局部上下文平滑逐标记路由,减少专家切换抖动;(3) 统一自我辩论将多样辩论人格封装为轻量级专家模块,无需代理间通信却保留行为多样性。在多模态基准测试中,MoD显著优于单模型基线与传统多代理系统,准确率更高,延迟降低3.7倍,令牌消耗减少87%。代码已开源。
原文摘要 · Abstract (English)
Existing multi-agent debate frameworks suffer from two critical limitations: they rely on static architectures where agent roles and coordination patterns are fixed at design time, and they require instantiating multiple model copies, incurring substantial computational overhead. We propose Mixture of Debaters (MoD), a unified framework that enables dynamic self-debate within a single model by leveraging the Mixture-of-Experts paradigm. We address three key challenges in adapting MoE for dialectical reasoning: (1) dual-routing that decouples role allocation from process flow, dynamically determining when to debate versus when to synthesize; (2) momentum switching that smooths token-level routing with local context, reducing expert-switch jitter; and (3) unified self-debate that encapsulates diverse debating personas into lightweight expert modules, eliminating inter-agent communication while preserving behavioral diversity. Extensive experiments on multimodal benchmarks demonstrate that MoD outperforms both single-model baselines and conventional multi-agent systems, achieving superior accuracy with 3.7x lower latency and 87% reduction in token consumption.The source code can be accessed at https://github.com/YongLD/MoD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。