arXiv:2504.11482cs.CVcs.AI2025-04被引 2

轻量级脉冲网络实现水下图像去雾,低功耗高效处理。

snnTrans-DHZ: A Lightweight Spiking Neural Network Architecture for Underwater Image Dehazing

论文配图:snnTrans-DHZ: A Lightweight Spiking Neural Network Architecture for Underwater Image Dehazing
图 1 · 摘自论文原文
  • 将静态图像转为时序输入,利用脉冲神经网络时间动态特性。
  • 在UIEB和EUVP数据集上分别达到21.68dB/0.8795和23.46dB/0.8439的性能。
  • 仅0.567万参数,7.42 GSOPs,0.0151J能耗,适合水下机器人部署。

水下图像去雾对基于视觉的海洋作业至关重要,因光线散射与吸收会严重降低能见度。本文提出snntTrans-DHZ,一种专为水下去雾设计的轻量级脉冲神经网络(SNN)。通过利用SNN的时间动态特性,该模型可高效处理依赖时间的原始图像序列,同时保持低功耗。静态水下图像通过在用户定义的时间步内重复输入,转化为时间依赖序列;随后将其转换为LAB颜色空间表示并并行处理。架构包含三个核心模块:(i) K估计算子,从多色彩空间表征中提取特征;(ii) 背景光估计算子,联合推断RGB-LAB图像中的背景光成分;(iii) 软图像重建模块,生成无雾、可视性增强的输出。模型采用基于替代梯度的通过时间反向传播(BPTT)策略进行端到端训练,并结合新型联合损失函数。在UIEB基准上,snntTrans-DHZ取得21.68 dB的PSNR和0.8795的SSIM;在EUVP数据集上,获得23.46 dB的PSNR和0.8439的SSIM。全模型仅含0.5670百万参数,计算量7.42 GSOPs,能耗0.0151 J,显著优于现有最优方法的效率。这些特性使其特别适用于水下机器人、海洋勘探与环境监测场景。

原文摘要 · Abstract (English)

Underwater image dehazing is critical for vision-based marine operations because light scattering and absorption can severely reduce visibility. This paper introduces snnTrans-DHZ, a lightweight Spiking Neural Network (SNN) specifically designed for underwater dehazing. By leveraging the temporal dynamics of SNNs, snnTrans-DHZ efficiently processes time-dependent raw image sequences while maintaining low power consumption. Static underwater images are first converted into time-dependent sequences by repeatedly inputting the same image over user-defined timesteps. These RGB sequences are then transformed into LAB color space representations and processed concurrently. The architecture features three key modules: (i) a K estimator that extracts features from multiple color space representations; (ii) a Background Light Estimator that jointly infers the background light component from the RGB-LAB images; and (iii) a soft image reconstruction module that produces haze-free, visibility-enhanced outputs. The snnTrans-DHZ model is directly trained using a surrogate gradient-based backpropagation through time (BPTT) strategy alongside a novel combined loss function. Evaluated on the UIEB benchmark, snnTrans-DHZ achieves a PSNR of 21.68 dB and an SSIM of 0.8795, and on the EUVP dataset, it yields a PSNR of 23.46 dB and an SSIM of 0.8439. With only 0.5670 million network parameters, and requiring just 7.42 GSOPs and 0.0151 J of energy, the algorithm significantly outperforms existing state-of-the-art methods in terms of efficiency. These features make snnTrans-DHZ highly suitable for deployment in underwater robotics, marine exploration, and environmental monitoring.

水下图像脉冲神经网络去雾轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。