arXiv:2511.21726cs.CLcs.AI2025-11被引 3

用原始数据搜索比压缩记忆更有效,显著提升长文本理解性能。

Goal-Directed Search Outperforms Goal-Agnostic Memory Compression in Long-Context Memory Tasks

  • 直接在未压缩数据中进行目标导向搜索,避免压缩损失
  • 在LoCoMo数据集上超越现有最佳方法43%准确率
  • 适合需要动态适应新数据的长时记忆应用

如何在大语言模型中实现类人长期记忆,是解锁少样本泛化等通用能力的核心问题。现有记忆框架和基准测试侧重于优化记忆压缩算法以提升回忆与推理任务表现,但此类方法常因适配特定基准而引入人类偏见。相比之下,对未压缩信息进行目标导向搜索可能更具优势,因为压缩必然带来信息损失,而预设压缩算法难以适应所有原始数据分布。本文提出SUMER(Search in Uncompressed Memory via Experience Replay),一种基于可验证奖励的端到端强化学习代理(RLVR),能自主学习使用搜索工具获取信息并回答目标问题。在长上下文对话理解数据集LoCoMo上,采用Qwen2.5-7B-Instruct的SUMER成功运用搜索工具,超越所有有偏见的记忆压缩方法及全上下文基线,达到当前最优性能(较先前最佳提升43%)。结果表明,在当前长时记忆任务中,对原始数据的简单搜索方法优于目标无关且有偏的压缩算法,呼吁建立更动态、可自主扩展的新范式与评估基准。SUMER及所有基线代码已公开于https://github.com/zycyc/SUMER。

原文摘要 · Abstract (English)

How to enable human-like long-term memory in large language models (LLMs) has been a central question for unlocking more general capabilities such as few-shot generalization. Existing memory frameworks and benchmarks focus on finding the optimal memory compression algorithm for higher performance in tasks that require recollection and sometimes further reasoning. However, such efforts have ended up building more human bias into the compression algorithm, through the search for the best prompts and memory architectures that suit specific benchmarks, rather than finding a general solution that would work on other data distributions. On the other hand, goal-directed search on uncompressed information could potentially exhibit superior performance because compression is lossy, and a predefined compression algorithm will not fit all raw data distributions. Here we present SUMER (Search in Uncompressed Memory via Experience Replay), an end-to-end reinforcement learning agent with verifiable reward (RLVR) that learns to use search tools to gather information and answer a target question. On the LoCoMo dataset for long-context conversation understanding, SUMER with Qwen2.5-7B-Instruct learned to use search tools and outperformed all other biased memory compression approaches and also the full-context baseline, reaching SOTA performance (43% gain over the prior best). We demonstrate that a simple search method applied to raw data outperforms goal-agnostic and biased compression algorithms in current long-context memory tasks, arguing for new paradigms and benchmarks that are more dynamic and autonomously scalable. Code for SUMER and all implemented baselines is publicly available at https://github.com/zycyc/SUMER.

长时记忆强化学习搜索增强大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。