揭示核霍普菲尔德网络存储极限的几何与动力学机制
Geometric and dynamical analysis of attractor boundaries and storage limits in kernel Hopfield networks

- 通过形态分析与信噪比研究,发现吸引子边界呈相变特征
- 随机序列存储上限达P/N≈16,结构化数据可达P/N≈20
- 存储极限主要受动态稳定性限制而非几何可分性
基于核逻辑回归(KLR)的高容量关联记忆表现出强大存储能力,但其稳定性的几何与动力学机制尚不明确。本文结合随机序列与真实图像嵌入(CIFAR-10)的实证评估、形态变化实验及统计信噪比(SNR)分析,研究了吸引子盆地的全局几何与存储极限机制。实验显示,网络对随机序列的存储容量可达P/N≈16,对结构化数据的有效负载接近P/N≈20。形态分析表明,“优化脊线”上的吸引子由陡峭的势能屏障和临界减速现象分隔,呈现相变特征。进一步对比SNR分析与受Cover定理启发的几何参考点,发现实际存储极限并非源于特征空间中缺乏几何可分性,而是由串扰噪声引发的动力学失稳所致。结果表明,KLR网络作为高度局部化的实例记忆系统,在动力学崩溃临界点附近运行,为构建鲁棒的大规模检索系统提供了新视角。
原文摘要 · Abstract (English)
High-capacity associative memories based on Kernel Logistic Regression (KLR) exhibit strong storage capabilities, but the dynamical and geometric mechanisms underlying their stability remain poorly understood. This paper investigates the global geometry of attractor basins and the mechanisms governing the storage limit in KLR-trained Hopfield networks. We combine empirical evaluations using random sequences and real-world image embeddings (CIFAR-10) with morphing experiments and statistical Signal-to-Noise Ratio (SNR) analysis. Our experiments show that the network achieves a storage capacity for random sequences up to $P/N \approx 16$, while maintaining stable retrieval for structured data at effective loads near $P/N \approx 20$. Morphing analysis indicates that attractors on the "Ridge of Optimization" are separated by sharp, phase-transition-like boundaries, characterized by steep effective potential barriers and critical slowing down. Furthermore, by comparing an SNR analysis with a geometric reference point inspired by Cover's theorem, we show that the practical storage limit is governed primarily not by a lack of geometric separability in the feature space, but by the loss of dynamical stability against crosstalk noise. These findings suggest that KLR networks function as highly localized exemplar-based memories that operate near the onset of dynamical collapse, providing a useful perspective on the design of robust, large-scale retrieval systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。