arXiv:2602.13639cs.AIcs.MA2026-02被引 1

通过熵值评估与经验检索,让强弱模型协作更高效。

Guided Collaboration in Heterogeneous LLM-Based Multi-Agent Systems via Entropy-Based Understanding Assessment and Experience Retrieval

  • 用多维度熵值衡量弱模型理解程度,动态调整指导强度。
  • 在GSM8K、MBPP、CVRP上显著提升异构协作效果。
  • 适合构建稳定高效的多智能体系统,尤其关注认知差异问题。

随着大语言模型在推理、规划和复杂任务生成方面的突破,人工智能系统正从单智能体转向多智能体协同架构。然而,在异构多智能体系统(HMAS)中,智能体能力差异导致持续的认知困境:强弱模型难以有效协作。我们定义了强-弱协作模式,实验揭示一个反直觉现象:强-弱协作可能表现不如弱-弱组合,表明认知错配是制约异构协作的关键瓶颈。为此,我们提出基于熵的自适应引导框架,通过表达、不确定性、结构、连贯性和相关性等多维熵指标量化弱模型的理解状态,并动态调节引导强度(轻度、中度、重度)。同时引入增强型生成检索机制(RAG),保留成功协作经验,实现即时适应与长期学习。在GSM8K、MBPP和CVRP三个基准数据集上的大量实验表明,该方法持续提升了异构协作的有效性与稳定性。结果表明,自适应引导不仅缓解认知失衡,还为构建更鲁棒、可扩展的协作式多智能体智能提供了可行路径。

原文摘要 · Abstract (English)

With recent breakthroughs in large language models (LLMs) for reasoning, planning, and complex task generation, artificial intelligence systems are transitioning from isolated single-agent architectures to multi-agent systems with collaborative intelligence. However, in heterogeneous multi-agent systems (HMAS), capability differences among agents give rise to consistent cognitive problems, where strong and weak models fail to contribute effectively. We define the collaboration as a strong-weak system. Through comprehensive experiments, we disclose a counterintuitive phenomenon in the strong-weak system: a strong-weak collaboration may under-perform weak-weak combinations, revealing that cognitive mismatching are key bottlenecks limiting heterogeneous cooperation. To overcome these challenges, we propose an Entropy-Based Adaptive Guidance Framework that dynamically aligns the guidance with the cognitive state of each agent. The framework quantifies the understanding of weak agents through multi-dimensional entropy metrics - covering expression, uncertainty, structure, coherence, and relevance - and adaptively adjusts the intensity of the guidance at light, moderate and intensive levels. Furthermore, a Retrieval-Augmented Generation (RAG) mechanism is incorporated to retain successful collaboration experiences, enabling both immediate adaptation and long-term learning. Extensive experiments on three benchmark datasets, GSM8K, MBPP, and CVRP demonstrate that our approach consistently enhances the effectiveness and stability of heterogeneous collaboration. The results highlight that adaptive guidance not only mitigates cognitive imbalance but also establishes a scalable pathway toward more robust, cooperative multi-agent intelligence.

多智能体协作优化熵评估RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。