arXiv:2510.11984cs.LG2025-10

从统计物理视角揭示神经动力学如何实现高效、局部学习。

Learning by Steering the Neural Dynamics: A Statistical Mechanics Perspective

  • 用统计力学分析随机非对称网络中的动态吸引子形成条件。
  • 发现自耦合强度引发相变:低值时存在孤立固定点与密集簇,高值时出现稠密广域簇。
  • 提出生物合理算法,在异步规则下通过局部可塑性实现监督学习,适用于多种架构。

尽管基于梯度优化的深度神经网络取得了显著成功,但其与生物系统存在根本差异。这一差距引发了关于自然如何以极低能耗、高效样本学习并解决信用分配问题而不依赖反向传播的关键疑问。本文通过统计力学工具,研究神经动力学如何支持完全局部化、分布式的可扩展学习。我们识别出随机非对称循环网络中稳健动态吸引子出现的条件,推导出自耦合强度与固定点数量的闭式表达式,并揭示其结构的相变现象:低于临界自耦合时,孤立固定点与指数级多的窄簇共存,呈现重叠间隙特性;高于该阈值时,次主导但稠密且广延的簇出现。这些固定点在算法相关的自耦合阈值后变得可访问,包括在简单异步动力学规则下。基于此分析,我们提出一种适用于任意二元循环网络的生物合理监督学习算法:通过瞬态外部刺激将输入映射至动态固定点,并利用局部可塑性稳定配置。结果表明,该算法可学习纠缠版MNIST,利用深度构建层次表征并提升异关联容量,且适用于多种架构。最后,我们强调算法性能与所揭示相变之间的强关联,并建议一种受皮层启发的自耦合替代机制以促进其涌现。

原文摘要 · Abstract (English)

Despite the striking successes of deep neural networks trained with gradient-based optimization, these methods differ fundamentally from their biological counterparts. This gap raises key questions about how nature achieves robust, sample-efficient learning at minimal energy costs and solves the credit-assignment problem without backpropagation. We take a step toward bridging contemporary AI and computational neuroscience by studying how neural dynamics can support fully local, distributed learning that scales to simple machine-learning benchmarks. Using tools from statistical mechanics, we identify conditions for the emergence of robust dynamical attractors in random asymmetric recurrent networks. We derive a closed-form expression for the number of fixed points as a function of self-coupling strength, and we reveal a phase transition in their structure: below a critical self-coupling, isolated fixed points coexist with exponentially many narrow clusters showing the overlap-gap property; above it, subdominant yet dense and extensive clusters appear. These fixed points become accessible, including to a simple asynchronous dynamical rule, after an algorithm-dependent self-coupling threshold. Building on this analysis, we propose a biologically plausible algorithm for supervised learning with any binary recurrent network. Inputs are mapped to fixed points of the dynamics, by relaxing under transient external stimuli and stabilizing the resulting configurations via local plasticity. We show that our algorithm can learn an entangled version of MNIST, leverages depth to develop hierarchical representations and increase hetero-association capacity, and is applicable to several architectures. Finally, we highlight the strong connection between algorithm performance and the unveiled phase transition, and we suggest a cortex-inspired alternative to self-couplings for its emergence.

神经动力学统计物理生物神经网络局部学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。