arXiv:2510.25993cs.LGcs.NE2025-10中稿 · EdgeAI4R Workshop,…

用时间相关性减少神经网络训练开销,适合边缘机器人实时学习。

Efficient Online Learning with Predictive Coding Networks: Exploiting Temporal Correlations

  • 通过保留时序隐状态,利用数据间相关性降低计算量。
  • 相比反向传播少10%权重更新,比基线预测编码少50%推理步骤。
  • 生物合理且适配类脑硬件,利于资源受限设备部署。

边缘运行的机器人系统需要高效的在线学习算法,以持续适应变化环境并处理流式感知数据。传统反向传播虽有效,但与生物合理性相悖,且在连续适应场景中可能不最优。预测编码(PC)框架提供了一种局部、类海马的更新规则,具备生物合理性,适合类脑硬件实现。然而,其主要局限在于训练中需多次迭代推理,导致计算开销大。本文提出带时间摊销的预测编码网络(PCN-TA),通过跨时序帧保留隐状态,利用时间相关性显著降低计算需求,同时保持学习性能。在COIL-20机器人感知数据集上的实验表明,PCN-TA相比反向传播减少10%权重更新,较基线PC网络减少50%推理步骤。这些效率提升直接降低计算负担,推动边缘部署与资源受限系统中的实时自适应能力。该方法的生物启发特性也使其成为未来类脑硬件实现的理想候选方案。

原文摘要 · Abstract (English)

Robotic systems operating at the edge require efficient online learning algorithms that can continuously adapt to changing environments while processing streaming sensory data. Traditional backpropagation, while effective, conflicts with biological plausibility principles and may be suboptimal for continuous adaptation scenarios. The Predictive Coding (PC) framework offers a biologically plausible alternative with local, Hebbian-like update rules, making it suitable for neuromorphic hardware implementation. However, PC's main limitation is its computational overhead due to multiple inference iterations during training. We present Predictive Coding Network with Temporal Amortization (PCN-TA), which preserves latent states across temporal frames. By leveraging temporal correlations, PCN-TA significantly reduces computational demands while maintaining learning performance. Our experiments on the COIL-20 robotic perception dataset demonstrate that PCN-TA achieves 10% fewer weight updates compared to backpropagation and requires 50% fewer inference steps than baseline PC networks. These efficiency gains directly translate to reduced computational overhead for moving another step toward edge deployment and real-time adaptation support in resource-constrained robotic systems. The biologically-inspired nature of our approach also makes it a promising candidate for future neuromorphic hardware implementations, enabling efficient online learning at the edge.

在线学习预测编码边缘计算类脑硬件

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。