arXiv:2606.31495cs.AIcs.LG2026-06

用意外信号同时控制记忆更新和认知判断,让模型学会何时该学、何时该问。

Surprise as a Signal for Plasticity and Metacognition

  • 用编码器潜空间的预测误差作为意外信号,决定是否存新概念
  • 在ImageNet持续流中,保留旧类准确率提升51.3分(I-JEPA)
  • 能区分已知/未知概念,比模型自身信心更准,适合个性化智能体

我们研究了一个核心思想:由小规模预测器在冻结编码器的潜空间中计算的预测误差信号,既能作为可塑性的开关,也能作为元认知的基础。在第一系统中,非参数化情景记忆仅在意外度高时写入新概念,并通过周期性离线重放将近期痕迹固化为慢速线性读出。在连续1000个ImageNet类别流上使用冻结的DINOv2或I-JEPA主干网络,重放阶段使最老类别的保留率分别提升17.7分(DINOv2)和51.3分(I-JEPA,单种子运行);消融实验表明,仅重放近期窗口反而不如不重放。少样本评估中,该记忆在5类1样本mini-ImageNet上达到91.6%,高于任务特定基线,而500类情形暴露了真实难度。在第二系统中,相同意外信号在共享文图空间中调节视觉语言模型行为:对已知概念自信回答,部分熟悉则含糊,完全陌生则拒绝识别并请求解释,仅凭一次用户话语即可学习新概念。外部检测器在区分已知与新概念上达AUROC 0.966(95%置信区间±0.024),远超模型自述信心(0.618);其标记级置信度在贪婪解码下低于随机水平。经历睡眠阶段清除快速存储后,系统从固化存储中回忆起99.2%的五十条知识,而基础模型无法恢复任何内容。两项系统均为概念验证,明确指出局限性,并将第二项与近期情景记忆及个性化视觉语言模型工作相对比。

原文摘要 · Abstract (English)

We study a single idea across two settings: that a prediction-error signal, computed by a small predictor over the latent space of a frozen encoder, can serve both as a gate on plasticity and as a substrate for metacognition. In the first system, a non-parametric episodic memory writes a new concept only when this surprise is high, and a periodic offline replay phase consolidates recent traces into a slow linear readout. On a continual stream of 1000 ImageNet classes with a frozen DINOv2 or I-JEPA backbone, the consolidation phase recovers 17.7 points of retention on the oldest classes for DINOv2 and 51.3 points for I-JEPA (single-seed runs), and an ablation shows that replaying only a recent window is worse than no replay at all. In few-shot evaluation the same memory reaches 91.6% on 5-way 1-shot mini-ImageNet, above a task-specific baseline, while a harder 500-way regime exposes the true difficulty. In the second system, the same surprise signal, computed in a shared text-image space, modulates the behaviour of a vision-language model: it answers assertively when a concept is known, hedges when it is partially familiar, and refuses to identify the object and asks for an explanation when it is novel, learning the concept from a single user utterance. The external detector separates known from novel concepts at an AUROC of 0.966 (95% CI +/-0.024), far above the model's own verbalised confidence (0.618), while its token-level confidence sits below chance under greedy decoding; after a sleep phase that empties the fast store, the system recalls 99.2% of fifty taught facts from the consolidated store while a base model recovers none. We report both systems as proof-of-concept, with explicit limitations, and position the second against recent episodic-memory and personalised-VLM work.

元认知可塑性记忆机制视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。