arXiv:2607.16027cs.LGcs.NE2026-07

赫布学习在结构约束下能更高效分配神经资源,降低信息冗余。

Constrained Hebbian Learning Supports Efficient Representational Allocation under Structural Constraints

论文配图:Constrained Hebbian Learning Supports Efficient Representational Allocation under Structural Constraints
图 1 · 摘自论文原文
  • 用兴奋性竞争赫布规则模拟突触资源分配,对抗生物约束。
  • 相比稀疏反向传播和差分目标传播,任务信息成本更低。
  • 适合研究神经编码效率的学者,尤其关注生物合理性模型。

生物系统受解剖与代谢限制,如突触维护成本高、连接受限,这促使神经编码倾向于将行为相关的信息压缩为低冗余模式。本文检验了兴奋性竞争赫布规则能否在这些约束下支持突触资源分配,并评估其产生的表征是否优于参考学习规则,在成本-性能权衡上表现更优。实验采用三个音视频基准(AVE、Kinetics-Sounds、VGGSound100)的固定嵌入,隔离下游关联可塑性。在匹配稀疏性和架构约束下,比较赫布学习、稀疏反向传播(BP)和差分目标传播(DDTP)。结果表明:赫布学习在主要压缩对比中实现了低于稀疏BP和DDTP的任务信息成本(CTI),且与非负权重浅层BP相当。并非普遍提升分类准确率,而是改变了任务相关信息与表征成本之间的权衡:在相似功能性能下,赫布表征保留更少输入信息,尽管部分数据集上准确率略有下降。说明赫布学习更适合作为突触资源分配机制,而非最大化音视频分类准确率的通用策略。

原文摘要 · Abstract (English)

Introduction: Biological systems face anatomical and metabolic constraints, including costly synaptic maintenance and limited connectivity. These constraints favor neural codes that compress behaviorally relevant information into low-redundancy patterns. We test whether an excitatory competitive Hebbian rule can support synaptic resource allocation under such constraints and whether the resulting representations occupy a more favorable cost-performance regime than reference learning rules. Methods: Representational cost is quantified using mutual-information-based measures derived from the Variational Information Bottleneck. Experiments use fixed audiovisual embeddings from three audiovisual benchmarks (AVE, Kinetics-Sounds, VGGSound100) to isolate downstream associative plasticity. Hebbian learning is compared with Dense Difference Target Propagation (DDTP) and backpropagation (BP) under matched sparsity and architectural constraints. Results: Hebbian learning achieves lower task-information cost (CTI) than sparse BP and DDTP in the main compressed comparisons, while reaching CTI values comparable to shallow BP with nonnegative weights. Rather than uniformly improving classification performance, Hebbian learning shifts the trade-off between task-relevant information and representational cost, yielding lower CTI at comparable functional performance in several settings. Discussion: The results indicate a cost-performance trade-off rather than uniform accuracy gains. For a given level of task-relevant information, Hebbian representations retain less input information while preserving functional performance, although accuracy is slightly reduced on some datasets. These findings support interpreting Hebbian learning as a mechanism for synaptic resource allocation rather than as a general strategy for maximizing audiovisual classification accuracy.

神经编码赫布学习资源分配信息瓶颈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。