用建构主义设计记忆系统,让大模型更高效理解长文档
CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehension
- 基于皮亚杰理论构建结构化、可自适应的记忆框架
- 在多项长文本任务中提升准确率与推理效率
- 适合需要深度理解长文档的智能阅读场景
当前大语言模型在理解长篇文档时面临信息过载问题。为此,我们借鉴让·皮亚杰的建构主义理论,提出三种代理记忆核心特征:结构化图式、灵活同化与动态顺应。基于此,我们设计了CAM(Constructivist Agentic Memory)原型系统,融合增量重叠聚类算法,支持层次化摘要生成与在线批量整合。推理时,CAM能自适应探索记忆结构,激活相关上下文信息,模拟人类联想过程。相比现有方法,CAM在问答、基于查询的摘要和主张验证等任务中均展现出性能与效率的双重优势。
原文摘要 · Abstract (English)
Current Large Language Models (LLMs) are confronted with overwhelming information volume when comprehending long-form documents. This challenge raises the imperative of a cohesive memory module, which can elevate vanilla LLMs into autonomous reading agents. Despite the emergence of some heuristic approaches, a systematic design principle remains absent. To fill this void, we draw inspiration from Jean Piaget's Constructivist Theory, illuminating three traits of the agentic memory -- structured schemata, flexible assimilation, and dynamic accommodation. This blueprint forges a clear path toward a more robust and efficient memory system for LLM-based reading comprehension. To this end, we develop CAM, a prototype implementation of Constructivist Agentic Memory that simultaneously embodies the structurality, flexibility, and dynamicity. At its core, CAM is endowed with an incremental overlapping clustering algorithm for structured memory development, supporting both coherent hierarchical summarization and online batch integration. During inference, CAM adaptively explores the memory structure to activate query-relevant information for contextual response, akin to the human associative process. Compared to existing approaches, our design demonstrates dual advantages in both performance and efficiency across diverse long-text reading comprehension tasks, including question answering, query-based summarization, and claim verification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。