让大模型协作系统跨任务积累经验,提升推理效率与质量。
Cross-Task Experiential Learning on LLM-based Multi-Agent Collaboration
- 构建图结构协作网络,让代理通过显式连接传递信息。
- 量化每步推理质量,存入个体经验池以备后续调用。
- 推理时复用高分经验,加速收敛并提升解题质量。
基于大语言模型的多智能体系统在复杂任务中展现出卓越的协同推理与互评能力。然而,现有方法通常将每个任务独立处理,导致计算冗余且跨任务泛化能力有限。为此,我们提出多智能体跨任务经验学习(MAEL)框架,赋予语言模型驱动的智能体显式的跨任务学习与经验积累能力。我们采用图结构多智能体协作网络建模任务求解流程,智能体通过显式连接传播信息并协调行动。在经验学习阶段,量化任务求解流程中每一步的质量,并将对应输入、输出及奖励存储至各智能体的独立经验池中。推理阶段,智能体检索高奖励、任务相关的经验作为少样本示例,增强每一步推理效果,从而实现更准确高效的多智能体协作。在多个数据集上的实验表明,MAEL使智能体能有效利用过往任务经验,显著加快收敛速度并生成更高质量的解决方案。
原文摘要 · Abstract (English)
Large Language Model-based multi-agent systems (MAS) have shown remarkable progress in solving complex tasks through collaborative reasoning and inter-agent critique. However, existing approaches typically treat each task in isolation, resulting in redundant computations and limited generalization across structurally similar tasks. To address this, we introduce multi-agent cross-task experiential learning (MAEL), a novel framework that endows LLM-driven agents with explicit cross-task learning and experience accumulation. We model the task-solving workflow on a graph-structured multi-agent collaboration network, where agents propagate information and coordinate via explicit connectivity. During the experiential learning phase, we quantify the quality for each step in the task-solving workflow and store the resulting rewards along with the corresponding inputs and outputs into each agent's individual experience pool. During inference, agents retrieve high-reward, task-relevant experiences as few-shot examples to enhance the effectiveness of each reasoning step, thereby enabling more accurate and efficient multi-agent collaboration. Experimental results on diverse datasets demonstrate that MAEL empowers agents to learn from prior task experiences effectively-achieving faster convergence and producing higher-quality solutions on current tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。