arXiv:2411.13230eess.IV2024-11被引 2

用深度学习修复水下图像的散射与边缘失真,提升清晰度和色彩还原。

OceanLens: An Adaptive Backscatter and Edge Correction using Deep Learning Model for Enhanced Underwater Imaging

  • 采用自适应散射与边缘损失函数,结合Sobel和LoG算子优化图像亮度与细节。
  • 在SeeThru数据集上,GPMAE降低65%,UIQM提升60%,显著优于现有方法。
  • 适合水下成像、海洋探测等需要高保真图像的应用场景。

水下环境因水体对光的选择性吸收与散射导致图像模糊、对比度下降和色彩失真。为此,我们提出OceanLens,一种基于神经网络的水下成像物理建模方法,同时处理后向散射与衰减问题。模型引入自适应散射与边缘修正损失,包括Sobel与LoG损失,以控制图像方差和亮度变化,获得更清晰准确的结果。此外,我们验证了预训练单目深度估计模型在生成水下深度图中的有效性。在SeeThru数据集上的评估显示,相比SeeThru与DeepSeeColor方法,平均GPMAE降低65%,UIQM提升60%。增加卷积层后,能更好捕捉细微图像特征。该架构在UIEB数据集上通过PSNR与SSIM指标验证,多层结构使SSIM提升达12-15%。

原文摘要 · Abstract (English)

Underwater environments pose significant challenges due to the selective absorption and scattering of light by water, which affects image clarity, contrast, and color fidelity. To overcome these, we introduce OceanLens, a method that models underwater image physics-encompassing both backscatter and attenuation-using neural networks. Our model incorporates adaptive backscatter and edge correction losses, specifically Sobel and LoG losses, to manage image variance and luminance, resulting in clearer and more accurate outputs. Additionally, we demonstrate the relevance of pre-trained monocular depth estimation models for generating underwater depth maps. Our evaluation compares the performance of various loss functions against state-of-the-art methods using the SeeThru dataset, revealing significant improvements. Specifically, we observe an average of 65% reduction in Grayscale Patch Mean Angular Error (GPMAE) and a 60% increase in the Underwater Image Quality Metric (UIQM) compared to the SeeThru and DeepSeeColor methods. Further, the results were improved with additional convolution layers that capture subtle image details more effectively with OceanLens. This architecture is validated on the UIEB dataset, with model performance assessed using Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) metrics. OceanLens with multiple convolutional layers achieves up to 12-15% improvement in the SSIM.

水下成像深度学习图像增强散射校正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。