提出分层记忆框架HiMem,让大模型对话能长期保持连贯与自我进化。
HiMem: Hierarchical Long-Term Memory for LLM Long-Horizon Agents
- 用双通道分割构建事件记忆,多阶段提取形成稳定知识笔记
- 在长对话测试中准确率、一致性均优于现有方法
- 适合需要长期交互的智能助手、虚拟角色等场景
尽管长期记忆系统近年取得显著进展,但在持续交互下仍存在适应性差、可扩展性不足和自我演进能力弱的问题。受认知理论启发,我们提出HiMem,一种面向长时对话的分层长期记忆框架,支持持续交互中的记忆构建、检索与动态更新。HiMem通过主题感知的事件-惊喜双通道分割策略构建认知一致的事件记忆,并利用多阶段信息抽取流程建立捕捉稳定知识的笔记记忆。两类记忆语义关联,形成连接具体交互事件与抽象知识的分层结构,实现高效检索且不损失信息精度。支持混合与尽力而为两种检索策略,在准确率与效率间平衡;引入冲突感知的记忆重构机制,根据检索反馈修正和补充存储知识,实现长期使用中的持续自我演化。在长时对话基准上的实验表明,HiMem在准确性、一致性及长期推理方面持续优于代表性基线,同时保持良好效率。总体而言,HiMem为构建自适应、可演进的大模型对话代理提供了一种原理清晰且可扩展的设计范式。代码已开源:https://github.com/jojopdq/HiMem。
原文摘要 · Abstract (English)
Although long-term memory systems have made substantial progress in recent years, they still exhibit clear limitations in adaptability, scalability, and self-evolution under continuous interaction settings. Inspired by cognitive theories, we propose HiMem, a hierarchical long-term memory framework for long-horizon dialogues, designed to support memory construction, retrieval, and dynamic updating during sustained interactions. HiMem constructs cognitively consistent Episode Memory via a Topic-Aware Event--Surprise Dual-Channel Segmentation strategy, and builds Note Memory that captures stable knowledge through a multi-stage information extraction pipeline. These two memory types are semantically linked to form a hierarchical structure that bridges concrete interaction events and abstract knowledge, enabling efficient retrieval without sacrificing information fidelity. HiMem supports both hybrid and best-effort retrieval strategies to balance accuracy and efficiency, and incorporates conflict-aware Memory Reconsolidation to revise and supplement stored knowledge based on retrieval feedback. This design enables continual memory self-evolution over long-term use. Experimental results on long-horizon dialogue benchmarks demonstrate that HiMem consistently outperforms representative baselines in accuracy, consistency, and long-term reasoning, while maintaining favorable efficiency. Overall, HiMem provides a principled and scalable design paradigm for building adaptive and self-evolving LLM-based conversational agents. The code is available at https://github.com/jojopdq/HiMem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。