让AI辩论时自动屏蔽错误记忆,提升推理准确性。
Multi-Agent Debate with Memory Masking
- 引入记忆掩码机制,让AI在辩论前主动过滤错误信息。
- 在数学与逻辑推理任务上,性能优于传统多智能体辩论框架。
- 适合需要高可靠推理的场景,如自动化证明与决策支持。
大型语言模型(LLMs)在推理任务中表现出色。当前主流框架多通过增加推理阶段采样来提升性能。其中,多智能体辩论(MAD)通过多个智能体进行多轮辩论,利用历史记忆迭代优化推理,显著增强推理能力。然而,我们发现尽管如此,仍存在错误记忆,且智能体易受其影响。理论分析表明,MAD性能高度依赖于前轮辩论生成的记忆质量,错误记忆会威胁整体表现。为此,我们提出多智能体辩论带记忆掩码(MAD-M²),在每轮辩论开始时允许智能体屏蔽错误记忆。该方法通过保留有效信息、丢弃错误内容,净化上下文。在主流数学与逻辑推理基准上的实验表明,MAD-M²能有效识别并排除错误记忆,在多项任务上超越MAD。
原文摘要 · Abstract (English)
Large language models (LLMs) have recently demonstrated impressive capabilities in reasoning tasks. Currently, mainstream LLM reasoning frameworks predominantly focus on scaling up inference-time sampling to enhance performance. In particular, among all LLM reasoning frameworks, *multi-agent debate* (MAD), which employs multiple LLMs as agents to perform reasoning in the way of multi-round debate, has emerged as a powerful reasoning paradigm since it allows agents to access previous memories to alleviate fallacious content and refine their reasoning iteratively in each debate round. However, although MAD significantly improves the reasoning capabilities of LLMs, in this paper, we observe that there remain erroneous memories, and LLM agents are vulnerable to these erroneous memories. To explore this phenomenon, we provide a theoretical insight that the performance of MAD is highly dependent on the quality of memories derived from the previous debate, indicating that the existence of erroneous memories poses a threat to the performance of MAD. To address this problem, we introduce a simple yet effective multi-agent debate framework, *multi-agent debate with memory masking* (MAD-M$^2$), to improve the robustness of MAD by allowing LLM agents to mask erroneous memories from the previous debate round at the beginning of each debate round. In this way, MAD-M$^2$ can polish the contextual information before each debate round by preserving informative and meaningful memories while discarding the erroneous memories. Extensive experiments and analyses on mainstream mathematical and logical reasoning benchmarks demonstrate that MAD-M$^2$ can identify the erroneous memories and achieve better performance in reasoning than MAD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。