arXiv:2502.15153cs.CL2025-02被引 2

发现大模型协作中分歧能促进纠错,路径多样时自修复能力更强。

When Disagreements Elicit Robustness: Investigating Self-Repair Capabilities under LLM Multi-Agent Disagreements

  • 用任务无关分歧和关键事实冲突模拟多智能体争论
  • 通用分歧提升成功率,关键分歧在单路径推理中大幅降低表现
  • 编程任务中可绕过错误信息,体现路径依赖的自修复能力

大语言模型已从文本生成工具演变为具备协作与工具调用能力的自主智能体。本文探讨分歧如何影响集体决策:普遍性、部分重叠的分歧能避免过早达成共识,拓展解空间;而关键步骤上的分歧则可能因解题路径结构不同导致合作失败。研究对比了两种协作场景:基于单一证据链的推理(CounterFact, MQuAKE-cf)与多路径实现的编程(HumanEval, GAIA)。通过引入智能体间差异及任务关键事实的反事实修改,实验表明:通用分歧始终提升成功度,鼓励互补探索;关键分歧在单路径推理中显著降低成功率,但在多路径编程任务中影响有限。追踪分析显示,编程任务中系统常绕过错误信息,推理任务则极少如此,揭示出一种依赖解题路径而非规模的涌现式自修复能力。代码已公开于 https://github.com/wbw625/MultiAgentRobustness。

原文摘要 · Abstract (English)

Recent advances in Large Language Models (LLMs) have upgraded them from sophisticated text generators to autonomous agents capable of cooperation and tool use in multi-agent systems (MAS). However, it remains unclear how disagreements shape collective decision-making. In this paper, we revisit the role of disagreement and argue that general, partially overlapping disagreements prevent premature consensus and expand the explored solution space, while disagreements on task-critical steps can derail collaboration depending on the topology of solution paths. We investigate two collaborative settings with distinct path structures: collaborative reasoning (CounterFact, MQuAKE-cf), which typically follows a single evidential chain, whereas collaborative programming (HumanEval, GAIA) often adopts multiple valid implementations. Disagreements are instantiated as general heterogeneity among agents and as task-critical counterfactual knowledge edits injected into context or parameters. Experiments reveal that general disagreements consistently improve success by encouraging complementary exploration. By contrast, task-critical disagreements substantially reduce success on single-path reasoning, yet have a limited impact on programming, where agents can choose alternative solutions. Trace analyses show that MAS frequently bypasses the edited facts in programming but rarely does so in reasoning, revealing an emergent self-repair capability that depends on solution-path rather than scale alone. Our code is available at https://github.com/wbw625/MultiAgentRobustness.

多智能体自修复大模型协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。