生物大脑的突触学习机制可高效实现梯度优化,无需显式计算梯度。
Heterosynaptic Circuits Are Universal Gradient Machines
- 利用异源突触可塑性构建通用梯度学习电路
- 模拟显示异源突触能解释神经元的元可塑性和灵活性
- 为生物学习与人工智能提供统一机制,适合神经科学与AI研究者
我们提出一种生物大脑学习回路的设计原理:几乎任何通过异源突触可塑性(HSP)更新的树突权重,都能实现一类广义且高效的基于梯度的元学习。该理论表明,大量生物学合理的学习算法与标准机器学习优化器可基于异源突触回路结构实现。这一原则揭示了(反)海氏(HBP)与异源突触可塑性(HSP)可能源于相同动态,提供了统一解释,并将HSP提升为学习与记忆的主要机制,而HBP成为涌现产物。模拟结果表明:(a) HSP可解释神经元的元可塑性;(b) HSP可解释生物回路的灵活性;(c) 梯度学习可由不显式计算梯度的简单进化动力学快速产生。尽管聚焦于生物学,该原理也暗示了新的人工智能训练算法与物理可学习硬件设计思路。概念上,结果表明梯度计算在自然界中可能极为普遍且容易实现。
原文摘要 · Abstract (English)
We propose a design principle for the learning circuits of the biological brain. The principle states that almost any dendritic weights updated via heterosynaptic plasticity can implement a generalized and efficient class of gradient-based meta-learning. The theory suggests that a broad class of biologically plausible learning algorithms, together with the standard machine learning optimizers, can be grounded in heterosynaptic circuit motifs. This principle suggests that the phenomenology of (anti-) Hebbian (HBP) and heterosynaptic plasticity (HSP) may emerge from the same underlying dynamics, thus providing a unifying explanation. It also suggests an alternative perspective of neuroplasticity, where HSP is promoted to the primary learning and memory mechanism, and HBP is an emergent byproduct. We present simulations that show that (a) HSP can explain the metaplasticity of neurons, (b) HSP can explain the flexibility of the biology circuits, and (c) gradient learning can arise quickly from simple evolutionary dynamics that do not compute any explicit gradient. While our primary focus is on biology, the principle also implies a new approach to designing AI training algorithms and physically learnable AI hardware. Conceptually, our result demonstrates that contrary to the common belief, gradient computation may be extremely easy and common in nature.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。