arXiv:2409.18476cs.CV2024-09被引 6

用物理模型+扩散模型,让水下图像增强更快更省算力

Underwater Image Enhancement with Physical-based Denoising Diffusion Implicit Models

  • 结合物理模型与轻量U-Net,替代耗算力的原模型组件
  • 推理速度提升,计算量大幅降低,各项指标仍保持领先
  • 适合资源受限的水下机器人实时图像处理

水下视觉对自主水下航行器(AUV)至关重要,但在算力受限的AUV上实时增强受光吸收与散射影响的水下图像仍是挑战。传统方法适应性差,基于学习的方法如CNN和GAN存在增强不足、训练不稳定或模式崩溃等问题。虽然去噪扩散概率模型(DDPM)在图像到图像任务中表现优异,但现有UW-DDPM方案计算复杂度高。本文提出UW-DiffPhys,通过将轻量级物理基础网络与去噪U-Net结合,取代原框架中高复杂度的分布变换U-Net,显著降低计算开销;同时采用去噪扩散隐式模型(DDIM)实现非马尔可夫采样以加速推理。实验表明,相比UW-DDPM,UW-DiffPhys在推理时间与计算复杂度上均有显著下降,且在PSNR、SSIM、UCIQE等关键指标上表现相当,整体水下图像质量(UIQM)进一步提升。

原文摘要 · Abstract (English)

Underwater vision is crucial for autonomous underwater vehicles (AUVs), and enhancing degraded underwater images in real-time on a resource-constrained AUV is a key challenge due to factors like light absorption and scattering, or the sufficient model computational complexity to resolve such factors. Traditional image enhancement techniques lack adaptability to varying underwater conditions, while learning-based methods, particularly those using convolutional neural networks (CNNs) and generative adversarial networks (GANs), offer more robust solutions but face limitations such as inadequate enhancement, unstable training, or mode collapse. Denoising diffusion probabilistic models (DDPMs) have emerged as a state-of-the-art approach in image-to-image tasks but require intensive computational complexity to achieve the desired underwater image enhancement (UIE) using the recent UW-DDPM solution. To address these challenges, this paper introduces UW-DiffPhys, a novel physical-based and diffusion-based UIE approach. UW-DiffPhys combines light-computation physical-based UIE network components with a denoising U-Net to replace the computationally intensive distribution transformation U-Net in the existing UW-DDPM framework, reducing complexity while maintaining performance. Additionally, the Denoising Diffusion Implicit Model (DDIM) is employed to accelerate the inference process through non-Markovian sampling. Experimental results demonstrate that UW-DiffPhys achieved a substantial reduction in computational complexity and inference time compared to UW-DDPM, with competitive performance in key metrics such as PSNR, SSIM, UCIQE, and an improvement in the overall underwater image quality UIQM metric. The implementation code can be found at the following repository: https://github.com/bachzz/UW-DiffPhys

水下图像扩散模型轻量化物理模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。