arXiv:2605.01383cs.LGcond-mat.dis-nn2026-05被引 1

用可微电阻网络研究持续学习中的遗忘问题

Sequential Learning and Catastrophic Forgetting in Differentiable Resistor Networks

论文配图:Sequential Learning and Catastrophic Forgetting in Differentiable Resistor Networks
图 1 · 摘自论文原文
  • 通过调整电阻导纳实现梯度学习,受基尔霍夫定律约束
  • 任务冲突越大,遗忘越严重;新任务适应度越高,遗忘越少
  • 高电流支路的局部电阻变化解释了主要遗忘机制

可微物理网络为研究学习过程提供了简单框架,其中可训练参数与物理平衡约束相互作用。本文研究基于基尔霍夫定律的可微电阻网络中的顺序学习。尽管可通过梯度调节边导纳学习单个输入-输出映射,但在冲突任务上的连续训练会导致灾难性遗忘。我们发现遗忘程度由任务冲突和对新任务的适应程度共同决定。统一锚定与归一化梯度加权锚定虽能减少遗忘,但会提高新任务的最终损失,体现出明确的遗忘-适应权衡。此外,遗忘与高电流支路上的局部导纳变化相关,对应主导输运路径的重构。在更广泛的随机任务集合中,当第二个任务反转第一个任务的输出排序时遗忘最强。在不同图结构(埃拉托斯特尼-雷尼、小世界、无标度、随机几何)上的对比显示,拓扑结构影响遗忘-适应平衡。这些结果表明,可微电阻网络是研究可调物质中持续学习的紧凑且具物理可解释性的测试平台。

原文摘要 · Abstract (English)

Differentiable physical networks provide a simple setting in which learning can be studied through the interaction between trainable parameters and physical equilibrium constraints. We investigate sequential learning in differentiable resistor networks governed by Kirchhoff's laws. Although individual input--output mappings can be learned by gradient-based adjustment of edge conductances, sequential training on conflicting tasks produces catastrophic forgetting. We show that forgetting is controlled by task conflict and by the degree of adaptation to the new task. Uniform anchoring and normalised gradient-weighted anchoring reduce forgetting only by increasing the final loss on the new task, giving a clear forgetting--adaptation trade-off. We also show that forgetting is associated with localised conductance changes on high-current edges, giving a physical interpretation as reconfiguration of dominant transport pathways. Broader random-task ensembles show that the strongest forgetting occurs when the second task reverses the output ordering imposed by the first task. Finally, comparisons across Erdős--Rényi, small-world, scale-free, and random-geometric graph ensembles show that topology changes the forgetting--adaptation balance. These results position differentiable resistor networks as compact, physically interpretable testbeds for studying continual learning in tunable matter.

持续学习电阻网络遗忘机制物理可解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。