arXiv:2606.29824cs.CLcs.AI2026-06被引 2

用隐式激活引导让大模型自动执行任务,不依赖文本指令

Neural Procedural Memory: Empowering LLM Agents with Implicit Activation Steering

论文配图:Neural Procedural Memory: Empowering LLM Agents with Implicit Activation Steering
图 1 · 摘自论文原文
  • 通过历史经验提取隐式激活向量,直接触发任务相关神经机制
  • 在四个基准上表现接近显式指令方法,且两者结合更鲁棒
  • 适合构建无需人工编写流程的自主智能体,尤其擅长连续交互

尽管大型语言模型在静态求解任务中表现出色,但将其转化为自主智能体仍具挑战性。这一转变需要持续的环境交互,而现有智能体缺乏持久的程序化记忆。当前方法主要依赖检索增强生成(RAG)将显式文本指令注入模型上下文,但仅依赖符号化指令易造成文本与动作脱节,难以激活正确的内部表征。为此,本文提出神经程序记忆(NPM),一种无需训练的框架,通过隐式激活引导而非显式指令来表示智能体记忆。通过将历史对比经验中的程序化技能提炼为激活空间中的引导向量,NPM可直接激活与任务相关的神经机制以指导执行。在四个智能体基准上的评估显示,NPM性能可媲美使用显式文本指令的基线方法。进一步结果表明,隐式引导与显式工作流相结合具有互补优势,提升任务执行鲁棒性。表征分析显示,这些引导向量编码了连贯的任务逻辑,在激活空间中形成有序结构。研究结果表明,隐式激活引导是管理智能体记忆的一种有前景的方法。

原文摘要 · Abstract (English)

While Large Language Models (LLMs) excel as static solvers, transforming them into autonomous agents remains challenging. This transition requires continuous environmental interaction, yet current agents lack the necessary persistent procedural memory. Existing approaches predominantly employ Retrieval-Augmented Generation (RAG) to inject explicit textual guidelines into model contexts. However, relying solely on symbolic instructions can introduce a text-action disconnect, frequently failing to activate the internal representations necessary for correct task execution. To address this, the paper introduces Neural Procedural Memory (NPM), a training-free framework that represents agent memory through implicit activation steering rather than explicit instructions. By distilling procedural skills from historical contrastive experiences into steering vectors in the activation space, NPM directly activates the task-relevant neural mechanisms to guide task execution. Evaluations across four agent benchmarks show that NPM performs comparably to baselines using explicit textual instructions. Furthermore, the results show that combining implicit steering with explicit workflows provides complementary advantages, leading to more robust task execution. Representational analyses indicate that these steering vectors encode consistent task logic, forming organized structures within the activation space. These findings suggest that implicit activation steering provides a promising approach for managing agent memory.

大模型智能体隐式记忆激活引导程序化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。