arXiv:2503.04223cs.CV2025-03NeurIPS被引 18

用脉冲神经网络实现高效遥感图像超分辨率,兼顾精度与能耗。

Spiking Meets Attention: Efficient Remote Sensing Image Super-Resolution with Attention Spiking Neural Networks

  • 设计脉冲注意力模块,联合优化膜电位与脉冲活动。
  • 在AID、DOTA、DIOR数据集上达到顶尖性能,计算量低。
  • 适合关注能效与高精度遥感重建的研究者。

脉冲神经网络(SNN)因其生物合理性与能效优势,正成为传统人工神经网络的有前景替代方案。尽管如此,SNN常受限于表达能力不足,且在遥感图像超分辨率(RSI)任务中尚未被充分探索。本文观察到不同纹理下脉冲信号强度变化显著,表明神经元处于活跃学习状态,由此启发我们采用SNN实现高效的遥感图像超分辨率。受注意力机制在捕捉显著信息方面的成功启发,提出脉冲注意力块(SAB),通过推断的注意力权重优化膜电位,进而调控脉冲活动,提升特征表示能力。关键贡献包括:1)打通时间与通道维度的独立调制,促进联合特征相关性学习;2)利用大规模遥感图像中的全局自相似模式推断空间注意力权重,引入有效先验以实现真实、精准的重建。基于SAB构建的SpikeSR模型,在AID、DOTA、DIOR等遥感基准上均取得领先性能,同时保持高计算效率。代码将发布于https://github.com/XY-boy/SpikeSR。

原文摘要 · Abstract (English)

Spiking neural networks (SNNs) are emerging as a promising alternative to traditional artificial neural networks (ANNs), offering biological plausibility and energy efficiency. Despite these merits, SNNs are frequently hampered by limited capacity and insufficient representation power, yet remain underexplored in remote sensing super-resolution (SR) tasks. In this paper, we first observe that spiking signals exhibit drastic intensity variations across diverse textures, highlighting an active learning state of the neurons. This observation motivates us to apply SNNs for efficient SR of RSIs. Inspired by the success of attention mechanisms in representing salient information, we devise the spiking attention block (SAB), a concise yet effective component that optimizes membrane potentials through inferred attention weights, which, in turn, regulates spiking activity for superior feature representation. Our key contributions include: 1) we bridge the independent modulation between temporal and channel dimensions, facilitating joint feature correlation learning, and 2) we access the global self-similar patterns in large-scale remote sensing imagery to infer spatial attention weights, incorporating effective priors for realistic and faithful reconstruction. Building upon SAB, we proposed SpikeSR, which achieves state-of-the-art performance across various remote sensing benchmarks such as AID, DOTA, and DIOR, while maintaining high computational efficiency. Code of SpikeSR will be available at https://github.com/XY-boy/SpikeSR.

脉冲神经网络遥感图像超分辨率注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。