让大模型代理自带专属记忆,解决协作中的遗忘与角色混乱问题。
Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory
- 每个代理拥有随输出动态更新的专属记忆,保持角色一致性和任务聚焦。
- 在三个基准数据集上表现达顶尖水平,尤其在记忆一致性上领先。
- 适合需要长期协作、结构化规划的复杂任务,如系统设计与流程优化。
基于大语言模型的多智能体系统在复杂协作问题求解中展现出巨大潜力,但受限于上下文窗口,普遍存在记忆不一致、角色偏离和流程失序等问题。本文提出内在记忆代理(Intrinsic Memory Agents)框架,通过代理专属的记忆机制,使其随输出动态演化,保持角色对齐并聚焦任务相关信息。该方法采用通用记忆模板,无需为新任务手工设计记忆提示。我们在PDDL、FEVER和ALFWorld数据集上进行评估,结果表明该方法在所有三项任务中均达到或超越现有最先进水平,尤其在一致性方面表现最优。此外,在一个复杂的数据管道设计任务中,我们的方法在可扩展性、可靠性、可用性、成本效益和文档质量五个指标上均优于对比方法,并获得额外定性支持。研究显示,通过内在记忆机制解决记忆瓶颈,可显著提升多智能体大模型系统在结构化规划任务中的能力。
原文摘要 · Abstract (English)
Multi-agent systems built on Large Language Models (LLMs) show exceptional promise for complex collaborative problem-solving, yet they face fundamental challenges stemming from context window limitations that impair memory consistency, role adherence, and procedural integrity. This paper introduces Intrinsic Memory Agents, a novel framework that addresses these limitations through agent-specific memories that evolve intrinsically with agent outputs. Specifically, our method maintains role-aligned memory that preserves specialized perspectives while focusing on task-relevant information. Our approach utilises a generic memory template applicable to new problems without the need to hand-craft specific memory prompts. We benchmark our approach on the PDDL, FEVER, and ALFWorld datasets, comparing its performance to existing state-of-the-art multi-agentic memory approaches and showing state-of-the-art or comparable performance across all three, with the highest consistency. An additional evaluation is performed on a complex data pipeline design task, and we demonstrate that our approach produces higher quality designs across 5 metrics: scalability, reliability, usability, cost-effectiveness, and documentation, plus additional qualitative evidence of the improvements. Our findings suggest that addressing memory limitations through intrinsic approaches can improve the capabilities of multi-agent LLM systems on structured planning tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。