arXiv:2602.18131cs.LG2026-02被引 1

将时序预测编码与实时递归学习结合,实现长程依赖的高效在线学习。

Learning Long-Range Dependencies with Temporal Predictive Coding

  • 引入在线影响矩阵追踪参数历史效应,保留局部性优势。
  • 在语言建模、翻译和无人机识别任务中表现接近反向传播结果。
  • 训练时的推理机制可复用于部署,提升系统鲁棒性。

时序预测编码为循环系统提供了局部化、可并行的在线学习机制,适用于类脑与边缘硬件。但其参数更新仅捕捉局部时间关系,忽略潜状态轨迹上参数的历史影响,难以处理长时程信用分配。本文首次将时序预测编码与实时递归学习(tPC-RTRL)结合,引入在线影响矩阵以追踪历史效应,同时保持类脑实现所需的时空局部性。在显式假设下,证明tPC-RTRL可精确恢复反向传播通过时间(BPTT)的梯度。实验显示,在多个任务中近似等效:在WikiText-103上字节级语言建模验证比特数分别为1.865(tPC-RTRL)与1.864(BPTT);CCMatrix子集上的英法翻译得分分别为20.23(tPC-RTRL)与20.29(BPTT)BLEU;真实纳米无人机系统辨识任务中平均位置误差为0.506米(tPC-RTRL)与0.505米(BPTT)。此外,训练中使用的迭代推理机制可在部署时复用以处理间歇状态观测,使无人机任务最终位置误差减半(0.402米对0.805米),表明学习与滤波可统一于同一计算框架。

原文摘要 · Abstract (English)

Temporal Predictive Coding provides a layer-local, parallelisable mechanism for learning in recurrent systems, making it an attractive candidate for online local learning on neuromorphic and edge hardware. However, its recurrent parameter update captures only local temporal relationships, neglecting the historic influence of parameters along the latent-state trajectory, and therefore struggles to assign credit over longer temporal horizons. This work combines for the first time Temporal Predictive Coding with Real-Time Recurrent Learning (tPC-RTRL), incorporating an online influence matrix that tracks this historic effect whilst preserving the spatial and temporal locality properties valued by neuromorphic implementations. Under explicit assumptions, we prove that tPC-RTRL recovers the gradients of backpropagation-through-time exactly. Empirically, a near-equivalence holds across several tasks of varying scale and complexity, including byte-level language modelling on WikiText-103 (tPC-RTRL vs. BPTT: 1.865 vs. 1.864 validation BPC), English--French translation on a CCMatrix subset (20.23 vs. 20.29 BLEU), and a realistic nanodrone system-identification benchmark (0.506m vs. 0.505m mean position error). Finally, we show that the iterative inference mechanism used during training can be reused at deployment time to incorporate intermittent state observations, halving final-position error relative to open-loop rollout on the nanodrone task (0.402m vs. 0.805m) and suggesting a path towards unifying learning and filtering within the same computational framework.

时序建模神经网络类脑计算在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。