arXiv:2511.19969cs.AI2025-11

通过剪枝通信图,让多模态多智能体系统更高效

M$^3$Prune: Hierarchical Communication Graph Pruning for Efficient Multi-Modal Multi-Agent Retrieval-Augmented Generation

  • 构建分层通信图,按模态分步剪枝冗余连接
  • 在多个基准上实现性能超越且令牌消耗大幅降低
  • 适合需要高效部署的多模态知识增强场景

多模态检索增强生成(mRAG)通过外部知识提升多模态大模型能力,证明多个智能体协作可显著超越单个模型。然而现有系统存在大量令牌开销与计算成本,制约大规模应用。为此,我们提出新型多模态多智能体分层通信图剪枝框架M$^3$Prune。该框架首先对文本和视觉模态进行模内图稀疏化,识别任务关键边;随后基于关键边构建动态通信拓扑,进行模间图稀疏化;最后逐步剪除冗余边,获得更高效、分层的通信结构。在通用与领域特定mRAG基准上的实验表明,本方法在保持优异性能的同时,显著降低令牌消耗,持续优于单智能体与鲁棒多智能体系统。

原文摘要 · Abstract (English)

Recent advancements in multi-modal retrieval-augmented generation (mRAG), which enhance multi-modal large language models (MLLMs) with external knowledge, have demonstrated that the collective intelligence of multiple agents can significantly outperform a single model through effective communication. Despite impressive performance, existing multi-agent systems inherently incur substantial token overhead and increased computational costs, posing challenges for large-scale deployment. To address these issues, we propose a novel Multi-Modal Multi-agent hierarchical communication graph PRUNING framework, termed M$^3$Prune. Our framework eliminates redundant edges across different modalities, achieving an optimal balance between task performance and token overhead. Specifically, M$^3$Prune first applies intra-modal graph sparsification to textual and visual modalities, identifying the edges most critical for solving the task. Subsequently, we construct a dynamic communication topology using these key edges for inter-modal graph sparsification. Finally, we progressively prune redundant edges to obtain a more efficient and hierarchical topology. Extensive experiments on both general and domain-specific mRAG benchmarks demonstrate that our method consistently outperforms both single-agent and robust multi-agent mRAG systems while significantly reducing token consumption.

多智能体图剪枝mRAG效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。