用策略引导查询,让大模型更有效帮人唤醒记忆。
MemoCue: Empowering LLM-Based Agents for Human Memory Recall via Strategy-Guided Querying
- 根据记忆遗忘场景设计五类策略地图,智能选择最佳唤醒方式。
- 通过树搜索优化策略选择与响应生成,提升记忆启发率17.74%。
- 适合心理辅导、教育回忆等需要精准记忆唤醒的场景。
基于代理的记忆唤起是人机交互领域的重要研究问题。传统方法中,代理通过其内置记忆模块检索信息以帮助用户回忆不完整或模糊的记忆,但受限于记忆模块容量,难以获取完整记忆,影响实际召回效果。记忆理论表明,通过有效线索可主动激活相关记忆。受此启发,我们提出一种策略引导的记忆唤起新方法,使代理能将原始查询转化为富含线索的高质量问题,以辅助用户回忆。为此,需解决两个关键挑战:(1)如何为不同遗忘场景选择合适的唤起策略?(2)如何在仅有抽象且稀疏标注的策略模式下生成高质量响应?为此,我们提出召回路由框架(Recall Router)。首先构建5W记忆地图,将记忆查询分为五类典型场景,并定义十五种对应策略模式;其次设计分层召回树结合蒙特卡洛树搜索算法,优化策略选择与响应生成。我们构建指令微调数据集,对多个开源大语言模型进行微调,开发出名为MemoCue的代理系统,在三个代表性数据集上的实验表明,其记忆启发率较现有基于LLM的方法提升17.74%。进一步的人工评估也验证了其在记忆唤起应用中的优势。
原文摘要 · Abstract (English)
Agent-assisted memory recall is one critical research problem in the field of human-computer interaction. In conventional methods, the agent can retrieve information from its equipped memory module to help the person recall incomplete or vague memories. The limited size of memory module hinders the acquisition of complete memories and impacts the memory recall performance in practice. Memory theories suggest that the person's relevant memory can be proactively activated through some effective cues. Inspired by this, we propose a novel strategy-guided agent-assisted memory recall method, allowing the agent to transform an original query into a cue-rich one via the judiciously designed strategy to help the person recall memories. To this end, there are two key challenges. (1) How to choose the appropriate recall strategy for diverse forgetting scenarios with distinct memory-recall characteristics? (2) How to obtain the high-quality responses leveraging recall strategies, given only abstract and sparsely annotated strategy patterns? To address the challenges, we propose a Recall Router framework. Specifically, we design a 5W Recall Map to classify memory queries into five typical scenarios and define fifteen recall strategy patterns across the corresponding scenarios. We then propose a hierarchical recall tree combined with the Monte Carlo Tree Search algorithm to optimize the selection of strategy and the generation of strategy responses. We construct an instruction tuning dataset and fine-tune multiple open-source large language models (LLMs) to develop MemoCue, an agent that excels in providing memory-inspired responses. Experiments on three representative datasets show that MemoCue surpasses LLM-based methods by 17.74% in recall inspiration. Further human evaluation highlights its advantages in memory-recall applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。