arXiv:2605.20293cs.LGcs.AI2026-05被引 1

用分层高斯滤波器实现无需迭代的闭式预测编码,提升训练速度与深度网络性能。

Closed-form predictive coding via hierarchical Gaussian filters

论文配图:Closed-form predictive coding via hierarchical Gaussian filters
图 1 · 摘自论文原文
  • 将预测编码建模为分层高斯滤波器,恢复精度加权信息传递机制。
  • 在FashionMNIST上达到接近反向传播的训练速度,且收敛更快、更适应在线学习。
  • 无需全局误差信号或迭代优化,适合生物可解释性要求高的模型研究。

预测编码(PC)为人工神经网络训练提供了一种局部且生物合理的方法,但现有方法存在训练慢、网络深度增加时性能急剧下降的问题。我们发现根源在于当前PC网络将精度矩阵固定为单位阵,忽略了变分推导所要求的精度加权预测误差。本文通过将预测编码网络表示为深层分层高斯滤波器(HGF),重建了精度加权的消息传递,实现了动态不确定性估计和符合赫布学习规则的更新机制。所提方法可在单一自由能目标下同步学习激活值、权重和精度,无需全局误差信号,且推理无需迭代或自动微分。在FashionMNIST上,该方法在每轮耗时上接近反向传播,收敛次数更少,并在在线学习、数据效率和概念漂移任务中表现更优。结果表明,具有在线精度学习的闭式变分推断为深度预测编码网络提供了可行基础,在保留生物学与可解释性优势的同时,避免了迭代松弛和全局误差信号。

原文摘要 · Abstract (English)

Predictive coding (PC) offers a local and biologically grounded alternative to backpropagation in the training of artificial neural networks, yet to date, it remains slower, and performance degrades sharply as network depth increases. We trace both problems to a single simplification: current PC networks fix the precision matrix to the identity, discarding precision-weighted prediction errors that the variational derivation requires to be fast, local, and Bayesian. We close this gap by expressing predictive coding networks as deep hierarchical Gaussian filters (HGFs) and restore precision-weighted message passing, yielding dynamic uncertainty estimates and Hebbian-compatible update rules at every layer. The resulting networks can simultaneously learn activations, weights, and precisions under a single free-energy objective, with no global error signal, and resolve inference without requiring iterations or automatic differentiation. On FashionMNIST, our solution approaches backpropagation in epoch-level wall-clock cost while converging in fewer epochs, and outperforms it on online, data efficiency, and concept-drift tasks. We thus establish that closed-form variational inference with online precision learning provides a tractable foundation for deep predictive coding networks, retaining biological and interpretative advantages, without requiring iterative relaxation or global error signals.

预测编码分层高斯滤波在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。