arXiv:2608.08226cond-mat.stat-mechcs.CV2026-08

用李代数方法提升霍普菲尔德网络容量,实现高维连续记忆存储与鲁棒恢复。

High-Capacity Generalized Hopfield Networks

论文配图:High-Capacity Generalized Hopfield Networks
图 1 · 摘自论文原文
  • 基于SU(d)对称空间构建连续变量霍普菲尔德网络,用李代数线性化非线性几何约束。
  • 当d=3时容量提升近10倍,随d增大快速增长,显著优于传统向量网络。
  • 适用于量子计算与物理系统实现,支持图像编码恢复,且具抗噪声的鲁棒性。

本文提出广义霍普菲尔德网络,其中记忆与神经元为位于黎曼流形上的连续变量,聚焦于特殊酉群SU(d)对应的对称空间。通过数值与解析(复本)方法,证明从d=3开始,临界容量几乎提升一个数量级,并随d迅速增长。为克服非线性几何约束,采用李代数方法(沿用Galitski, Phys. Rev. A 84, 012118 (2011))将经典神经网络精确表示为辅助希尔伯特空间中的线性代数形式。结果表明,与传统霍普菲尔德网络不同,SU(d)网络的记忆恢复对应于稀疏矩阵的主特征向量对齐,较其他连续变量模型更抗随机矩阵串扰。简要讨论了实现SU(d)霍普菲尔德的物理平台,并演示了通过广义朗道-利夫希茨-吉尔伯特动力学实现物理层面的自然记忆恢复。以SU(3)为例,引入颜色(RGB)图像编码/解码协议,显式展示了在受损提示下的图像恢复。最后,对广义霍普菲尔德进行量子化,结果还原为萨赫德-耶玻璃类模型,其多体谱通常包含暗带和记忆带,后者呈现混沌的威格纳-迪拉克能级统计,隐藏海布结构数据。

原文摘要 · Abstract (English)

Generalized Hopfield networks are introduced where memories and neurons are continuous variables that lie on a Riemannian manifold. We explicitly focus on symmetric spaces associated with the special unitary groups SU(d), and use both numerical and analytical (replica) techniques to demonstrate an almost order of magnitude enhancement in critical capacity over the vector networks starting with d=3 and further rapidly growing with d. To circumvent the non-linear geometric constraints, we use a Lie algebraic method [following V. Galitski, Phys. Rev. A 84, 012118 (2011)] to exactly describe the classical neural network in terms of linear algebra in an auxiliary Hilbert space. It is shown that in contrast to the traditional Hopfield networks, memory recall in SU(d) Hopfields corresponds to neuron alignment along a top eigenvector of a spiked matrix, which is less susceptible to random matrix crosstalk than other models with continuous neuron variables. Physical platforms to realize SU(d) Hopfields are briefly discussed and physical (in addition to algorithmic) recall mechanism is demonstrated, where memory recovery occurs naturally through generalized Landau-Lifshitz-Gilbert dynamics. To illustrate SU(3) memory recall, we introduce a color (RGB) image encoding/decoding protocol and explicitly run image recovery on corrupted cues. Finally, we quantize the generalized Hopfields which are shown to reduce to Sachdev-Ye glassy type of models. Their many-body spectra generally feature two types of dark and memory bands, where the latter exhibits chaotic Wigner-Dyson level statistics that hides Hebbian data.

神经网络记忆容量李代数量子化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。