arXiv:2505.01218cs.LGcs.NE2025-05中稿 · NOLTA, IEICE被引 4

揭示核方法提升霍普菲尔德网络存储容量的内在规律。

Quantitative Attractor Analysis of High-Capacity Kernel Hopfield Networks

  • 通过核逻辑回归分析吸引子景观,建立性能设计准则。
  • 存储容量与网络规模线性正相关,需按规模调整核宽。
  • 对正则化参数不敏感,适合构建鲁棒联想记忆系统。

基于核的学习方法如核逻辑回归(KLR)可显著提升霍普菲尔德网络的存储容量,但其性能与稳定性机制仍不明确。本文通过大规模统计验证模拟,系统分析了KLR训练网络的吸引子结构,揭示关键规律。对比发现,KLR与核岭回归(KRR)在典型条件下均具备高存储容量和清晰吸引子景观,表明此特性是核回归方法的共性,尽管KRR计算更快。研究发现核宽γ存在非平凡的尺度依赖规律:最优容量要求γN随网络规模N增大而增加,即大网络需更局部化的核以减少模式间干扰。在此优化尺度下,存储容量与网络大小呈线性关系(P ∝ N)。敏感性分析显示,性能对正则化参数λ选择不敏感。这些结果为设计高容量、鲁棒的联想记忆提供了明确的实证原则,并阐明了核方法如何突破传统霍普菲尔德模型的局限。

原文摘要 · Abstract (English)

Kernel-based learning methods such as Kernel Logistic Regression (KLR) can substantially increase the storage capacity of Hopfield networks, but the principles governing their performance and stability remain largely uncharacterized. This paper presents a comprehensive quantitative analysis of the attractor landscape in KLR-trained networks to establish a solid foundation for their design and application. Through extensive, statistically validated simulations, we address critical questions of generality, scalability, and robustness. Our comparative analysis shows that KLR and Kernel Ridge Regression (KRR) exhibit similarly high storage capacities and clean attractor landscapes under typical operating conditions, suggesting that this behavior is a general property of kernel regression methods, although KRR is computationally much faster. We identify a non-trivial, scale-dependent law for the kernel width $γ$, demonstrating that optimal capacity requires $γ$ to be scaled such that $γN$ increases with network size $N$. This finding implies that larger networks require more localized kernels, in which each pattern's influence is more spatially confined, to mitigate inter-pattern interference. Under this optimized scaling, we provide clear evidence that storage capacity scales linearly with network size~($P \propto N$). Furthermore, our sensitivity analysis shows that performance is remarkably robust with respect to the choice of the regularization parameter $λ$. Collectively, these findings provide a concise set of empirical principles for designing high-capacity and robust associative memories and clarify the mechanisms that enable kernel methods to overcome the classical limitations of Hopfield-type models.

霍普菲尔德网络核方法存储容量吸引子分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。