arXiv:2604.12811cs.LGcs.AI2026-04中稿 · ICLR

提出DAM的有限样本保证,揭示其鲁棒性与存储容量规律

Algorithmic Analysis of Dense Associative Memory: Finite-Size Guarantees and Adversarial Robustness

  • 基于可验证的模式分离条件,给出有限规模下的收敛保证
  • 证明异步更新下收敛时间仅需O(log N),支持每轮容忍一定比特错误
  • 首次建立潜在博弈框架,确保动态收敛至稳定解

密集关联记忆(DAM)通过高阶相互作用扩展了霍普菲尔德网络,在满足适当模式分离条件下,存储容量可达O(N^{n-1})。现有动态分析多集中于热力学极限N→∞且随机采样模式的情形,无法提供有限样本保证或明确收敛速率。本文发展了算法化分析方法,给出了在显式可验证模式条件下,有限规模N下的精确保证。在分离假设与高负载下有界干扰条件下,证明异步检索动态具有几何收敛性,一旦轨迹进入吸引盆,收敛时间即为O(log N)。进一步建立了基于显式边距条件的对抗鲁棒性边界,量化每轮可容忍的破坏比特数;推导出最坏情况下容量保证为Θ(N^{n-1}),并恢复随机模式集合下的经典Θ(N^{n-1})标度。最后,证明了DAM检索动态具备潜在博弈结构,确保在异步更新下收敛至纯纳什均衡。完整证明见附录,并辅以初步实验验证预测的收敛、鲁棒性与容量标度行为。

原文摘要 · Abstract (English)

Dense Associative Memory (DAM) generalizes Hopfield networks through higher-order interactions and achieves storage capacity that scales as $O(N^{n-1})$ under suitable pattern separation conditions. Existing dynamical analyses primarily study the thermodynamic limit $N\to\infty$ with randomly sampled patterns and therefore do not provide finite-size guarantees or explicit convergence rates. We develop an algorithmic analysis of DAM retrieval dynamics that yields finite-$N$ guarantees under explicit, verifiable pattern conditions. Under a separation assumption and a bounded-interference condition at high loading, we prove geometric convergence of asynchronous retrieval dynamics, which implies $O(\log N)$ convergence time once the trajectory enters the basin of attraction. We further establish adversarial robustness bounds expressed through an explicit margin condition that quantifies the number of corrupted bits tolerable per sweep, and derive capacity guarantees that scale as $Θ(N^{n-1})$ up to polylogarithmic factors in the worst case, while recovering the classical $Θ(N^{n-1})$ scaling for random pattern ensembles. Finally, we show that DAM retrieval dynamics admit a potential-game interpretation that ensures convergence to pure Nash equilibria under asynchronous updates. Complete proofs are provided in the appendices, together with preliminary experiments that illustrate the predicted convergence, robustness, and capacity scaling behavior.

关联记忆收敛分析鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。