解决多智能体系统在持续学习中通信结构遗忘的问题
MasFACT: Continual Multi-Agent Topology Learning via Geometry-Aware Posterior Transfer

- 通过几何感知后验迁移,保留历史协作模式作为先验知识
- 在连续任务中平均准确率提升,拓扑遗忘减少37%以上
- 适合需要长期协作的复杂任务系统,兼容多种拓扑生成器
基于大语言模型的多智能体系统(MAS)在复杂问题求解中表现优异,其性能高度依赖于智能体间的通信拓扑。然而现有拓扑生成方法主要针对孤立任务优化,而在真实场景中任务流持续演化,需保留并复用先前有效的协作模式,而非重新发现或覆盖。我们识别出一种此前未被充分关注的失败模式——拓扑遗忘,即适应新任务时导致拓扑生成器偏离早期任务所需的通信结构。该问题源于任务间智能体功能语义与关系通信结构的跨任务不一致。为此,我们提出 extsc{MasFACT},一种几何感知后验迁移框架,将历史协作知识作为可转移的拓扑先验进行保留与复用。通过融合的格罗莫夫-沃瑟斯坦最优传输,在任务特异性智能体空间间传递这些先验,并采用PAC-Bayes引导的保守后验适配,平衡任务特异性可塑性与结构稳定性。在类别级、领域级和任务级连续设置下的实验表明, extsc{MasFACT} 在平均准确率上持续提升,拓扑遗忘显著减少,且可无缝集成至不同拓扑生成器。
原文摘要 · Abstract (English)
Multi-agent systems (MAS) powered by large language models (LLMs) have emerged as a powerful paradigm for complex problem solving, where performance critically depends on the underlying inter-agent communication topology. However, existing topology generation methods mainly optimize for isolated tasks, while real-world deployments involve streams of evolving tasks, requiring previously effective collaboration patterns to be retained and reused rather than rediscovered or overwritten. We identify a previously underexplored failure mode, \emph{topology forgetting}, in which adapting to new tasks shifts the topology generator away from communication structures required by earlier tasks. This issue stems from cross-task misalignment in both agent-level functional semantics and relational communication structures. To address this challenge, we propose \textbf{\textsc{MasFACT}}, a geometry-aware posterior transfer framework that preserves and reuses historical collaboration knowledge as transferable topology priors. We transfer these priors across task-specific agent spaces through Fused Gromov-Wasserstein optimal transport and perform PAC-Bayes-guided conservative posterior adaptation to balance task-specific plasticity with structural stability. Experiments across class-, domain-, and task-level continual settings demonstrate that \textsc{MasFACT} consistently improves average accuracy while reducing topology forgetting compared to strong topology generation and replay-based baselines, and can be seamlessly integrated with different MAS topology generators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。