通过稀疏化策略降低多智能体辩论的令牌消耗,提升效率。
S$^2$-MAD: Breaking the Token Barrier to Enhance Multi-Agent Debate Efficiency
- 引入稀疏化机制,减少无效对话和冗余讨论。
- 在多个数据集上实现最高94.5%的令牌成本下降。
- 适合需要高效推理且资源受限的场景使用。
大语言模型(LLM)在自然语言处理任务中表现出色,但在复杂算术与逻辑推理方面仍面临挑战。尽管链式思维(CoT)、自一致性(SC)及自我修正策略已尝试引导模型进行多步推理,多智能体辩论(MAD)已成为提升LLM推理能力的有效方法。增加智能体数量和辩论频率可显著提升性能,但导致令牌成本大幅上升,制约可扩展性。为此,本文提出一种新型稀疏化策略,旨在降低MAD中的令牌开销。该方法减少信息无效交换和无益讨论,从而提升辩论整体效率。在多个数据集和不同模型上的对比实验表明,该方法显著降低了MAD的令牌成本。具体而言,相较于传统MAD,本方法可实现高达94.5%的令牌成本降低,同时性能下降控制在2.0%以内。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated remarkable capabilities across various natural language processing (NLP) scenarios, but they still face challenges when handling complex arithmetic and logical reasoning tasks. While Chain-Of-Thought (CoT) reasoning, self-consistency (SC) and self-correction strategies have attempted to guide models in sequential, multi-step reasoning, Multi-agent Debate (MAD) has emerged as a viable approach for enhancing the reasoning capabilities of LLMs. By increasing both the number of agents and the frequency of debates, the performance of LLMs improves significantly. However, this strategy results in a significant increase in token costs, presenting a barrier to scalability. To address this challenge, we introduce a novel sparsification strategy designed to reduce token costs within MAD. This approach minimizes ineffective exchanges of information and unproductive discussions among agents, thereby enhancing the overall efficiency of the debate process. We conduct comparative experiments on multiple datasets across various models, demonstrating that our approach significantly reduces the token costs in MAD to a considerable extent. Specifically, compared to MAD, our approach achieves an impressive reduction of up to 94.5\% in token costs while maintaining performance degradation below 2.0\%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。