让大模型记忆检索能力像技能一样自我进化,提升复杂问题解答效果。
ERSkill: Evolving for Skill-Guided Adaptive Memory Retrieval

- 将检索行为抽象为可执行的技能,用路由器动态匹配最优策略。
- 在多个基准上比现有方法平均提升31.3%(Qwen3)和28.1%(GPT-5.4-nano)。
- 适合需要长期记忆与自适应推理的智能体系统开发者使用。
大型语言模型代理日益依赖长期记忆实现持续交互,但记忆检索机制通常被视为静态组件,限制了对异构查询的处理能力。为此,本文提出基于检索的自进化技能引导记忆访问框架 ERSkill。ERSkill 将交互历史结构化存储,并将检索行为表示为由基础操作构成的可执行技能。推理时,训练好的路由器动态匹配查询与最优技能,以构建定制化证据。为支持持续优化,ERSkill 在训练中协同演化技能集与路由器。其采用经验前缀树高效记录探索路径,并通过双前沿机制安全分离新技能拓展与稳定部署。在多个代理记忆基准测试中,ERSkill 显著优于强基线,分别在 F1、BLEU-1 与 LLM 评分上实现 31.3%(Qwen3-Next-80B-A3B-Instruct)与 28.1%(GPT-5.4-nano)的平均提升。
原文摘要 · Abstract (English)
While Large Language Model (LLM) agents increasingly rely on long-term memory for persistent interactions, the retrieval mechanisms governing this memory are rarely treated as evolvable components. This static approach limits performance on heterogeneous memory queries, which often demand diverse evidence construction strategies. To address this, we introduce \textbf{ERSkill}, a retrieval-centric framework for self-evolving, skill-guided memory access. ERSkill compiles interaction histories into a structured memory store and represents retrieval behaviors as executable skills composed of fundamental primitives. At inference time, a trained router dynamically matches each query to the optimal skill to construct tailored evidence for answer generation. To enable continuous improvement, ERSkill co-evolves the skill set and the router during training. It employs an experience trie to efficiently record explored retrieval paths, alongside a double-frontier mechanism that safely decouples the expansion of new skill capabilities from stable, router-facing deployment. Experiments across multiple agent memory benchmarks demonstrate that ERSkill substantially outperforms strong non-evolving and self-evolving baselines. Notably, it improves the overall average across F1, BLEU-1, and LLM-judge scores by 31.3\% with Qwen3-Next-80B-A3B-Instruct and by 28.1\% with GPT-5.4-nano.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。