arXiv:2605.05703cs.MAcs.AI2026-05

主动挑选关键任务,优化大模型多智能体通信结构。

Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systems

论文配图:Active Learning for Communication Structure Optimization in LLM-Based Multi-Agent Systems
图 1 · 摘自论文原文
  • 用信息论评估任务价值,选最能改进通信结构的样本。
  • 在有限算力下,提升性能并降低对训练数据的敏感性。
  • 适合资源受限场景,尤其对抗攻击下仍稳定有效。

基于大语言模型的多智能体系统(LLM-MAS)的通信结构优化已被证明可提升下游性能并减少令牌使用量。现有方法通常依赖随机采样的训练任务,但任务在难度和领域上差异显著,导致其对通信结构更新的信息量不均,使在有限训练预算下的优化过程不稳定且高度依赖具体数据集。为主动识别最具价值的任务,本文提出一种基于集成的信息论任务选择框架。该方法通过候选任务对图参数分布的影响程度来估计任务的启发性,采用集成卡尔曼反演作为高效且无需导数的贝叶斯更新近似。该估计器特别适用于黑箱与噪声环境下的多智能体系统。为增强可扩展性,我们通过嵌入式代表性筛选构建紧凑候选池,并结合代理建模与批量汤普森采样。我们在无攻击与存在智能体攻击的设置下验证了方法的有效性,证明其在计算资源受限条件下仍能实现有效的通信结构优化。

原文摘要 · Abstract (English)

Optimizing the communication structure of large language model based multi-agent systems (LLM-MAS) has been shown to improve downstream performance and reduce token usage. Existing methods typically rely on randomly sampled training tasks. However, tasks may differ substantially in difficulty and domain, and thus they are not equally informative for updating communication structure, making optimization under limited training budgets often unstable and highly sensitive to the particular training set. To actively identify the most valuable tasks for communication-structure optimization, we propose an ensemble-based information-theoretic task selection framework. The proposed method estimates task informativeness by how much a candidate task changes the distribution over graph parameters, using ensemble Kalman inversion as an efficient and derivative-free approximation of the corresponding Bayesian update. The resulting estimator is especially suitable for black-box and noisy multi-agent systems. To enhance scalability, we construct a compact candidate pool through embedding-based representative selection and combine the informative selection with surrogate modeling and batch Thompson sampling. We validate our method in both benign settings and settings with agent attacks, demonstrating its effectiveness for communication-structure optimization under constrained computational budgets.

多智能体主动学习通信优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。