用卷积结构增强记忆模型抗干扰能力,显著提升图像重建精度。
Robust Auto-associative Memory via Convolutional Restricted Hopfield Networks

- 结合卷积提取与吸引子机制,在潜空间实现结构化记忆
- 在多种攻击下重建误差降低一个数量级,性能稳定
- 适合需要高鲁棒性的图像恢复与记忆系统
关联记忆模型在模式检索中起基础作用,但在对抗扰动和严重输入退化下性能常下降。现有方法如现代霍普菲尔德网络(MHNs)和预测编码网络(PCNs)在存储容量、计算效率与鲁棒性之间难以平衡。本文提出卷积受限霍普菲尔德网络(CRHNs),将卷积特征提取与吸引子记忆检索相结合,基于子空间表示和不动点动力学,通过无梯度子空间旋转算法(SRA)训练,提升了鲁棒性与存储容量。在自教学习(STL)数据集上的大量实验表明,CRHNs在各种对抗攻击和输入退化下均显著降低重建误差,许多情况下误差减少一个数量级,并在扰动强度增加时保持稳定性能。统计分析确认改进显著(p < 0.01)。结果表明吸引子记忆机制有效,CRHNs为构建鲁棒且可扩展的关联记忆系统提供了有前景的框架。
原文摘要 · Abstract (English)
Associative memory models play a fundamental role in pattern retrieval, but their performance often degrades under adversarial perturbations and severe input corruptions. Existing approaches, including Modern Hopfield Networks (MHNs), and Predictive Coding Networks (PCNs), exhibit limitations in balancing storage capacity, computational efficiency, and robustness. In this paper, we propose a Convolutional Restricted Hopfield Networks (CRHNs), which integrates convolutional feature extraction with attractor-based memory retrieval in a structured latent space. The proposed model leverages subspace representations and fixed-point dynamics, trained via a gradient-free Subspace Rotation Algorithm (SRA), to enhance both robustness and memory capacity. Extensive experiments on Self-Taught Learning (STL) dataset demonstrate that CRHNs consistently achieve significantly lower reconstruction error compared to MHNs and PCNs across a wide range of adversarial attacks and input degradations. In many cases, CRHNs reduce reconstruction error by an order of magnitude and maintains stable retrieval performance under increasing perturbation strength. Statistical analysis further confirms that these improvements are significant ($p < 0.01$). These results highlight the effectiveness of attractor-based memory mechanisms and suggest that CRHNs provide a promising framework for building robust and scalable associative memory systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。