arXiv:2504.01755cs.CV2025-04被引 1

用ANN教SNN,让低功耗神经网络也能高效修复图像。

Bridge the Gap between SNN and ANN for Image Restoration

  • 用ANN的中间特征指导SNN训练,加速收敛
  • 模型参数少1/300,能耗低1/50,效果接近ANN
  • 适合低功耗设备上的图像修复任务

基于传统人工神经网络(ANN)的密集预测模型能耗较高,尤其在图像修复任务中。基于脉冲神经网络(SNN)的模型虽能将能耗降至同架构ANN的10%以下,但其训练成本高,因采用启发式梯度下降策略,膜电位信号从稀疏到密集的变化过程缓慢,影响模型收敛。为此,本文提出一种新型蒸馏方法——非对称框架(ANN-SNN)蒸馏,以ANN为教师,SNN为学生,利用ANN学习到的中间特征(特征图)作为提示,指导SNN训练。该方法不仅加速了SNN的收敛,还提升了其最终性能,有效弥合了SNN能效优势与ANN学习能力之间的差距。大量实验表明,所设计的SNN图像修复模型参数量仅为教师网络的1/300,能耗仅为教师网络的1/50,在部分去噪任务上表现与教师网络相当。

原文摘要 · Abstract (English)

Models of dense prediction based on traditional Artificial Neural Networks (ANNs) require a lot of energy, especially for image restoration tasks. Currently, neural networks based on the SNN (Spiking Neural Network) framework are beginning to make their mark in the field of image restoration, especially as they typically use less than 10\% of the energy of ANNs with the same architecture. However, training an SNN is much more expensive than training an ANN, due to the use of the heuristic gradient descent strategy. In other words, the process of SNN's potential membrane signal changing from sparse to dense is very slow, which affects the convergence of the whole model.To tackle this problem, we propose a novel distillation technique, called asymmetric framework (ANN-SNN) distillation, in which the teacher is an ANN and the student is an SNN. Specifically, we leverage the intermediate features (feature maps) learned by the ANN as hints to guide the training process of the SNN. This approach not only accelerates the convergence of the SNN but also improves its final performance, effectively bridging the gap between the efficiency of the SNN and the superior learning capabilities of ANN. Extensive experimental results show that our designed SNN-based image restoration model, which has only 1/300 the number of parameters of the teacher network and 1/50 the energy consumption of the teacher network, is as good as the teacher network in some denoising tasks.

图像修复脉冲神经网络能效优化知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。