arXiv:2510.19897cs.CLcs.AI2025-10被引 3

不改参数也能让大模型学会分类,靠的是记忆和自我反思。

Learning from Supervision with Semantic and Episodic Memory: A Reflective Approach to Agent Adaptation

  • 用情景记忆存具体经验,语义记忆提炼通用指导,实现无更新学习。
  • 相比零样本基线提升8.1个百分点,推理消耗减少31.95%。
  • 适合追求高效、可解释性模型适配的研究者与应用开发者。

我们研究如何让基于预训练大语言模型(LLMs)的智能体在不进行参数更新的情况下,仅通过标注样例学习目标分类函数。传统方法如微调成本高、灵活性差且不可解释。本文提出一种基于记忆的增强框架,利用模型生成的、以标注数据为基础的批判性反馈。该框架使用情景记忆存储实例级批判(捕捉具体经验),并用语义记忆将这些批判提炼为可复用的任务级指导。在多种任务和模型上,最佳自批判策略(结合两种记忆类型)相比零样本基线平均提升8.1个百分点,比仅依赖标签的RAG基线提升4.6个百分点。但性能提升在不同模型和领域间差异显著。为此,我们引入‘可建议性’(suggestibility)这一新指标,衡量模型对上下文提供外部推理的接受程度。该指标揭示了记忆增强何时有效或失效。除准确率提升外,预计算批判大幅降低推理阶段计算量,平均减少31.95%的思考令牌,替代了模型原本需独立完成的推理过程。研究结果表明,在特定条件下,基于记忆的反思式学习可成为提升大模型适应性的轻量、可解释、高效策略。

原文摘要 · Abstract (English)

We investigate how agents built on pretrained large language models (LLMs) can learn target classification functions from labeled examples without parameter updates. While conventional approaches like fine-tuning are often costly, inflexible, and opaque, we propose a memory-augmented framework that leverages LLM-generated critiques grounded in labeled data. Our framework uses episodic memory to store instance-level critiques - capturing specific past experiences - and semantic memory to distill these into reusable, task-level guidance. Across a diverse set of tasks and models, our best performing self-critique strategy (utilizing both memory types) yields an average improvement of 8.1 percentage points over the zero shot baseline, and 4.6pp over a RAG-based baseline that relies only on labels. However, improvements vary substantially across models and domains. To explain this variation, we introduce suggestibility - a novel metric capturing how receptive a model is to external reasoning provided in context. We use suggestibility to illuminate when and why memory augmentation succeeds or falls short. Beyond accuracy gains, we find pre-computed critiques substantially reduce inference-time computation for reasoning models, cutting thinking tokens by an average of 31.95% across all datasets by substituting for reasoning that the model would otherwise perform independently. Our findings highlight the conditions under which memory-driven, reflective learning can serve as a lightweight, interpretable, and efficient strategy for improving LLM adaptability.

大模型适应记忆机制零样本学习推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。