扩展平衡传播至非保守系统,实现精确梯度学习
Equilibrium Propagation for Non-Conservative Systems
- 通过引入非互易项修正学习动态,获得精确梯度
- 在前馈网络上验证,性能优于已有方法
- 适合研究神经动力学与非保守学习系统的学者
平衡传播(Equilibrium Propagation, EP)是一种受物理启发的学习算法,利用动力系统的稳定状态进行推理与学习。其原始形式仅适用于保守系统,即由能量函数导出的动力系统。由于实际应用广泛,将其推广至非保守系统——即具有非互易相互作用的系统——至关重要。此前的尝试未能计算出代价函数的精确梯度。本文提出一个框架,将EP扩展至任意非保守系统,包括前馈网络。保持使用稳定状态进行推理与学习的核心特性,但在学习阶段引入与非互易部分成比例的修正项,从而获得精确梯度。该算法还可通过变分形式推导,其学习动力由增广状态空间上的能量函数生成。数值实验表明,该方法性能更优且学习速度更快。
原文摘要 · Abstract (English)
Equilibrium Propagation (EP) is a physics-inspired learning algorithm that uses stationary states of a dynamical system both for inference and learning. In its original formulation it is limited to conservative systems, $\textit{i.e.}$ to dynamics which derive from an energy function. Given their applications, it is important to extend EP to non-conservative systems, $\textit{i.e.}$ systems with non-reciprocal interactions. Previous attempts to generalize EP to such systems failed to compute the exact gradient of the cost function. Here we propose a framework that extends EP to arbitrary non-conservative systems, including feedforward networks. We keep the key property of equilibrium propagation, namely the use of stationary states both for inference and learning. However, we modify the dynamics in the learning phase by a term proportional to the non-reciprocal part of the interaction so as to obtain the exact gradient of the cost function. This algorithm can also be derived using a variational formulation that generates the learning dynamics through an energy function defined over an augmented state space. Numerical experiments show that this algorithm achieves better performance and learns faster than previous proposals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。