arXiv:2604.00067cs.LGcond-mat.stat-mech2026-04

用随机过程模拟记忆,实现低资源持续学习,遗忘机制可精确计算。

Temporal Memory for Resource-Constrained Agents: Continual Learning via Stochastic Compress-Add-Smooth

论文配图:Temporal Memory for Resource-Constrained Agents: Continual Learning via Stochastic Compress-Add-Smooth
图 1 · 摘自论文原文
  • 记忆被建模为桥式扩散过程,通过压缩-添加-平滑三步更新
  • 遗忘源于时间压缩损失,保留半衰期与片段数线性相关
  • 无需反向传播,适合轻量级硬件,理论可解释性强

在固定内存预算下,顺序运行的智能体需在不遗忘旧经验的前提下融入新经验。本文提出一种新框架:记忆并非参数向量,而是一个定义在重放区间[0,1]上的桥式扩散过程,其终态边缘分布编码当前状态,中间边缘分布编码过往经历。新经验通过压缩-添加-平滑(CAS)递归方式融合。模型中边缘概率密度由固定分量数K的高斯混合表示,时间复杂度由固定数量L个分段线性协议段控制,每段节点存储高斯混合状态。整个递归每日报酬成本为O(LKd²)浮点运算,无需反向传播、无需存储数据、无需神经网络,适用于轻量控制器硬件。遗忘并非由参数干扰引起,而是源于在固定段数限制下对更精细协议的粗糙近似。我们发现保留半衰期与段数线性相关,即a₁/₂ ≈ cL,其中常数c>1取决于系统动力学,但独立于混合复杂度K、维度d及目标族几何结构。该常数c具有类似香农信道容量的信息论解释。支撑桥式过程的随机过程提供时序一致的‘影像’重放——压缩的历史叙事,在MNIST潜在空间可视化中得以展示。该框架为持续学习提供了完全解析的‘伊辛模型’,使遗忘机制、速率与形式能以数学精度研究。

原文摘要 · Abstract (English)

An agent that operates sequentially must incorporate new experience without forgetting old experience, under a fixed memory budget. We propose a framework in which memory is not a parameter vector but a stochastic process: a Bridge Diffusion on a replay interval $[0,1]$, whose terminal marginal encodes the present and whose intermediate marginals encode the past. New experience is incorporated via a three-step \emph{Compress--Add--Smooth} (CAS) recursion. We test the framework on the class of models with marginal probability densities modeled via Gaussian mixtures of fixed number of components~$K$ in $d$ dimensions; temporal complexity is controlled by a fixed number~$L$ of piecewise-linear protocol segments whose nodes store Gaussian-mixture states. The entire recursion costs $O(LKd^2)$ flops per day -- no backpropagation, no stored data, no neural networks -- making it viable for controller-light hardware. Forgetting in this framework arises not from parameter interference but from lossy temporal compression: the re-approximation of a finer protocol by a coarser one under a fixed segment budget. We find that the retention half-life scales linearly as $a_{1/2}\approx c\,L$ with a constant $c>1$ that depends on the dynamics but not on the mixture complexity~$K$, the dimension~$d$, or the geometry of the target family. The constant~$c$ admits an information-theoretic interpretation analogous to the Shannon channel capacity. The stochastic process underlying the bridge provides temporally coherent ``movie'' replay -- compressed narratives of the agent's history, demonstrated visually on an MNIST latent-space illustration. The framework provides a fully analytical ``Ising model'' of continual learning in which the mechanism, rate, and form of forgetting can be studied with mathematical precision.

持续学习随机过程低资源遗忘机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。