arXiv:2512.18575cs.LGcs.AI2025-12

发现神经形态记忆机制在不同感官任务中表现差异显著,需针对性优化。

Modality-Dependent Memory Mechanisms in Cross-Modal Neuromorphic Computing

  • 对比三种记忆机制在视觉与听觉数据上的表现差异
  • 霍普菲尔德网络在视觉任务中达97.68%准确率,听觉仅76.15%
  • 首次实证神经形态记忆应按模态定制,适合硬件加速研究者

内存增强的脉冲神经网络(SNNs)有望实现节能的神经形态计算,但其跨感官模态的泛化能力尚未被探索。我们首次对SNN中的记忆机制开展全面的跨模态消融研究,评估了霍普菲尔德网络、分层门控循环网络(HGRN)和监督对比学习(SCL)在视觉(N-MNIST)与听觉(SHD)神经形态数据集上的表现。系统评估五种架构揭示显著的模态依赖性能模式:霍普菲尔德网络在视觉任务中达97.68%准确率,但在听觉任务中仅76.15%(相差21.53个百分点),表现出严重模态特异性;而SCL则展现更均衡的跨模态性能(视觉96.72%,听觉82.16%,差距14.56个百分点)。结果表明,记忆机制具有任务特定优势而非通用适用性。联合多模态训练使用HGRN取得94.41%视觉与79.37%听觉准确率(平均88.78%),与并行部署的HGRN性能相当。定量痕迹分析显示跨模态对齐度极低(相似度0.038),验证了并行架构设计。本工作首次为神经形态系统中模态特异性记忆优化提供实证依据,能耗比传统神经网络降低603倍。

原文摘要 · Abstract (English)

Memory-augmented spiking neural networks (SNNs) promise energy-efficient neuromorphic computing, yet their generalization across sensory modalities remains unexplored. We present the first comprehensive cross-modal ablation study of memory mechanisms in SNNs, evaluating Hopfield networks, Hierarchical Gated Recurrent Networks (HGRNs), and supervised contrastive learning (SCL) across visual (N-MNIST) and auditory (SHD) neuromorphic datasets. Our systematic evaluation of five architectures reveals striking modality-dependent performance patterns: Hopfield networks achieve 97.68% accuracy on visual tasks but only 76.15% on auditory tasks (21.53 point gap), revealing severe modality-specific specialization, while SCL demonstrates more balanced cross-modal performance (96.72% visual, 82.16% audio, 14.56 point gap). These findings establish that memory mechanisms exhibit task-specific benefits rather than universal applicability. Joint multi-modal training with HGRN achieves 94.41% visual and 79.37% audio accuracy (88.78% average), matching parallel HGRN performance through unified deployment. Quantitative engram analysis confirms weak cross-modal alignment (0.038 similarity), validating our parallel architecture design. Our work provides the first empirical evidence for modality-specific memory optimization in neuromorphic systems, achieving 603x energy efficiency over traditional neural networks.

神经形态计算记忆机制跨模态脉冲网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。