arXiv:2510.14810cs.LG2025-10NeurIPS

提出新型无监督学习方法,让神经网络像生物一样自适应地连接突触。

Rethinking Hebbian Principle: Low-Dimensional Structural Projection for Unsupervised Learning

  • 通过结构投影机制实现局部非线性反馈,约束权重更新。
  • 在CIFAR-10等数据集上达到当前最优无监督性能。
  • 适合持续学习与迁移学习场景,特征更具泛化能力。

海布学习是一种直观描述神经元通过重复刺激调整连接的生物学原理。但在机器学习中,由于连接更新无约束且缺乏反馈调节,导致其难以扩展到复杂网络和任务。为此,本文提出结构投影海布表征(SPHeRe),通过局部辅助非线性模块整合正交性与结构信息保留。结构信息保留损失经轻量级投影反向传播,概念上充当反馈调节;正交性约束则控制更新幅度的有界性。大量实验表明,SPHeRe在标准图像分类基准(如CIFAR-10、CIFAR-100、Tiny-ImageNet)上达到当前最优无监督突触可塑性方法性能。此外,该方法在持续学习、迁移学习及图像重建任务中均表现优异,证明了所提取特征的鲁棒性与泛化能力。本工作展示了海布式无监督学习规则在现代深度学习框架中的竞争力与潜力,证实了无需强依赖严格反向传播的高效生物启发学习算法可行性。代码已开源:https://github.com/brain-intelligence-lab/SPHeRe。

原文摘要 · Abstract (English)

Hebbian learning is a biological principle that intuitively describes how neurons adapt their connections through repeated stimuli. However, when applied to machine learning, it suffers serious issues due to the unconstrained updates of the connections and the lack of accounting for feedback mediation. Such shortcomings limit its effective scaling to complex network architectures and tasks. To this end, here we introduce the Structural Projection Hebbian Representation (SPHeRe), a novel unsupervised learning method that integrates orthogonality and structural information preservation through a local auxiliary nonlinear block. The loss for structural information preservation backpropagates to the input through an auxiliary lightweight projection that conceptually serves as feedback mediation while the orthogonality constraints account for the boundedness of updating magnitude. Extensive experimental results show that SPHeRe achieves SOTA performance among unsupervised synaptic plasticity approaches on standard image classification benchmarks, including CIFAR-10, CIFAR-100, and Tiny-ImageNet. Furthermore, the method exhibits strong effectiveness in continual learning and transfer learning scenarios, and image reconstruction tasks show the robustness and generalizability of the extracted features. This work demonstrates the competitiveness and potential of Hebbian unsupervised learning rules within modern deep learning frameworks, demonstrating the possibility of efficient and biologically inspired learning algorithms without the strong dependence on strict backpropagation. Our code is available at https://github.com/brain-intelligence-lab/SPHeRe.

无监督学习海布法则生物启发特征提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。