arXiv:2608.02290cs.CV2026-08被引 1

用脉冲神经网络实现低功耗图像修复,自动生成有效事件信号。

SpikeRestormer: Towards Energy-Efficient All-in-One Image Restoration via Unified Event Reasoning

论文配图:SpikeRestormer: Towards Energy-Efficient All-in-One Image Restoration via Unified Event Reasoning
图 1 · 摘自论文原文
  • 通过内部生成脉冲信号感知退化特征
  • 在相同性能下能耗降低显著,达新SNN基准
  • 适合实时部署的低功耗图像修复场景

基于人工神经网络(ANN)的统一图像修复(AiOIR)虽能处理多种退化问题,但计算开销大,难以实时部署。脉冲神经网络(SNN)具备低功耗优势,但应用于静态图像仍面临挑战:缺乏显式事件信号,且退化线索与场景结构高度纠缠,难以学习可靠的修复相关脉冲。为此,我们提出SpikeRestormer,一种面向能量高效的SNN图像修复框架,通过内在生成的脉冲信号进行事件推理。具体地,设计减法退化事件注意力(SDEA)以提取基于脉冲的退化事件;引入分层贝叶斯跳过掩码(HBSM)进行事件可靠性推断,以及加法修复事件注意力(AREA)构建修复事件。三者协同,将修复过程统一为退化事件感知、可靠性推理与修复事件构造。大量实验表明,SpikeRestormer性能媲美主流ANN方法,同时在所有SNN方法中达到新最优,且能耗显著更低。

原文摘要 · Abstract (English)

ANN-based All-in-One image restoration (AiOIR) unifies diverse degradation handling but incurs high computational costs, limiting its real-time deployment. While Spiking Neural Networks (SNNs) offer a low-power alternative, applying them to static images remains challenging. This difficulty arises because explicit event signals are absent, and degradation cues are heavily entangled with scene structures, hindering the learning of reliable restoration-oriented spike events. To address these issues, we propose SpikeRestormer, an energy-efficient SNN for AiOIR that performs event reasoning over internally generated spike cues. Specifically, we propose a degradation-event perception process to extract spike-based degradation events through Subtractive Degradation Event Attention (SDEA). Moreover, we introduce Hierarchical Bayesian Skip Masking (HBSM) and Additive Restoration Event Attention (AREA) processes for event-reliability inference and restoration-event construction, respectively. By integrating these complementary processes, SpikeRestormer formulates restoration as a unified process of degradation-event perception, degradation-event reliability inference, and restoration-event construction, liberating the potential of SNNs for energy-efficient AiOIR. Extensive experiments show that SpikeRestormer delivers competitive performance against ANN-based methods and establishes new state-of-the-art results among SNN-based methods with significantly lower energy consumption.

图像修复脉冲神经网络低功耗统一模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。