arXiv:2503.20485eess.IVcs.AI2025-03被引 3

用脉冲神经网络提升水下图像清晰度,能效比传统方法高6.5倍。

Underwater Image Enhancement by Convolutional Spiking Neural Networks

  • 设计19层脉冲卷积编码解码架构,直接用梯度反向传播训练。
  • 在UIEB和EUVP数据集上实现PSNR 17.78dB/23.17dB,SSIM 0.7454/0.7890。
  • 能耗仅0.1327J,算力需求147.49 GSOPs,适合边缘设备部署。

水下图像增强(UIE)对海洋自主导航等应用至关重要。本文提出首个基于脉冲神经网络(SNN)的UIE算法——UIE-SNN,采用19层卷积编码解码结构并引入跳跃连接,通过代理梯度的反向传播时序(BPTT)策略直接训练。该方法在潜在空间优化损失函数,以重建清晰水下图像。在两大数据集UIEB与EUVP上训练后,在未见数据集(UIEB、EUVP、LSUI、U45及自建数据集)上测试,分别取得PSNR 17.7801 dB、SSIM 0.7454(UIEB)和PSNR 23.1725 dB、SSIM 0.7890(EUVP)的性能。在仅5个时间步下,能耗降低至0.1327 J,算力为147.49 GSOPs,远低于非脉冲对照模型(GFLOPs=218.88,Energy=1.0068 J)。相较现有最先进方法,平均能效提升6.5倍。代码已开源。

原文摘要 · Abstract (English)

Underwater image enhancement (UIE) is fundamental for marine applications, including autonomous vision-based navigation. Deep learning methods using convolutional neural networks (CNN) and vision transformers advanced UIE performance. Recently, spiking neural networks (SNN) have gained attention for their lightweight design, energy efficiency, and scalability. This paper introduces UIE-SNN, the first SNN-based UIE algorithm to improve visibility of underwater images. UIE-SNN is a 19- layered convolutional spiking encoder-decoder framework with skip connections, directly trained using surrogate gradient-based backpropagation through time (BPTT) strategy. We explore and validate the influence of training datasets on energy reduction, a unique advantage of UIE-SNN architecture, in contrast to the conventional learning-based architectures, where energy consumption is model-dependent. UIE-SNN optimizes the loss function in latent space representation to reconstruct clear underwater images. Our algorithm performs on par with its non-spiking counterpart methods in terms of PSNR and structural similarity index (SSIM) at reduced timesteps ($T=5$) and energy consumption of $85\%$. The algorithm is trained on two publicly available benchmark datasets, UIEB and EUVP, and tested on unseen images from UIEB, EUVP, LSUI, U45, and our custom UIE dataset. The UIE-SNN algorithm achieves PSNR of \(17.7801~dB\) and SSIM of \(0.7454\) on UIEB, and PSNR of \(23.1725~dB\) and SSIM of \(0.7890\) on EUVP. UIE-SNN achieves this algorithmic performance with fewer operators (\(147.49\) GSOPs) and energy (\(0.1327~J\)) compared to its non-spiking counterpart (GFLOPs = \(218.88\) and Energy=\(1.0068~J\)). Compared with existing SOTA UIE methods, UIE-SNN achieves an average of \(6.5\times\) improvement in energy efficiency. The source code is available at \href{https://github.com/vidya-rejul/UIE-SNN.git}{UIE-SNN}.

水下图像脉冲神经网络能效优化边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。