arXiv:2602.03546cs.LGcond-mat.dis-nn2026-02被引 2

提出新算法,让电阻网络高效训练且省电。

How to Train Your Resistive Network: Generalized Equilibrium Propagation and Analytical Learning

  • 基于基尔霍夫定律的解析框架精确计算梯度。
  • 无需全网读取,仅输出层更新即可训练电阻网络。
  • 可只更新部分电阻值,性能下降小,适合硬件部署。

机器学习虽强大,但当前数字硬件能耗极高。人们希望用模拟计算实现类似性能却更节能的替代方案。然而,受物理特性限制,如何在局部约束下训练这类系统仍不明确。局部学习算法如平衡传播和耦合学习被提出应对此问题。本文提出一种基于图论与解析方法的梯度计算算法,可精确求解基于基尔霍夫定律的梯度。同时引入广义平衡传播框架,涵盖包括耦合学习与平衡传播在内的多种赫布学习算法,并进行对比分析。数值仿真表明,该方法无需对所有电阻进行复制或读取,仅需在输出层操作即可完成训练;此外,在解析梯度方法下,仅更新部分电阻值也能保持良好性能,显著降低计算开销。

原文摘要 · Abstract (English)

Machine learning is a powerful method of extracting meaning from data; unfortunately, current digital hardware is extremely energy-intensive. There is interest in an alternative analog computing implementation that could match the performance of traditional machine learning while being significantly more energy-efficient. However, it remains unclear how to train such analog computing systems while adhering to locality constraints imposed by the physical (as opposed to digital) nature of these systems. Local learning algorithms such as Equilibrium Propagation and Coupled Learning have been proposed to address this issue. In this paper, we develop an algorithm to exactly calculate gradients using a graph theoretic and analytical framework for Kirchhoff's laws. We also introduce Generalized Equilibrium Propagation, a framework encompassing a broad class of Hebbian learning algorithms, including Coupled Learning and Equilibrium Propagation, and show how our algorithm compares. We demonstrate our algorithm using numerical simulations and show that we can train resistor networks without the need for a replica or readout over all resistors, only at the output layer. We also show that under the analytical gradient approach, it is possible to update only a subset of the resistance values without a strong degradation in performance.

模拟计算电阻网络能量效率梯度计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。