arXiv:2512.05866cs.CV2025-12中稿 · presentation at th…

用Transformer改进水下图像修复,颜色更准、对比更强。

Underwater Image Reconstruction Using a Swin Transformer-Based Generator and PatchGAN Discriminator

  • 用Swin Transformer+U-Net结构捕捉全局特征和局部细节
  • 在EUVP数据集上达到24.76dB的PSNR和0.89的SSIM
  • 适合海洋探测、环境监测等需要高清水下图像的场景

水下成像对海洋勘探、环境监测和基础设施检查至关重要,但水体引起的波长依赖性吸收与散射导致严重图像退化,出现色彩失真、低对比度和雾效。传统重建方法与基于卷积神经网络的方案因感受野有限且无法建模全局依赖而表现不佳。本文提出一种融合Swin Transformer的生成对抗网络框架:生成器采用带Swin Transformer块的U-Net结构,以捕获整幅图像的颜色校正所需的关键长程依赖与局部特征;判别器采用PatchGAN以保障高频细节保留。模型在包含不同质量配对水下图像的EUVP数据集上训练与评估,定量结果显示其性能达最优,PSNR为24.76 dB,SSIM为0.89,显著优于现有方法。视觉结果表明颜色平衡恢复有效,对比度提升明显,去雾效果良好。消融实验验证了Swin Transformer结构相较卷积方案的优势。该方法为多种海洋应用提供鲁棒的水下图像重建能力。

原文摘要 · Abstract (English)

Underwater imaging is essential for marine exploration, environmental monitoring, and infrastructure inspection. However, water causes severe image degradation through wavelength-dependent absorption and scattering, resulting in color distortion, low contrast, and haze effects. Traditional reconstruction methods and convolutional neural network-based approaches often fail to adequately address these challenges due to limited receptive fields and inability to model global dependencies. This paper presented a novel deep learning framework that integrated a Swin Transformer architecture within a generative adversarial network (GAN) for underwater image reconstruction. Our generator employed a U-Net structure with Swin Transformer blocks to capture both local features and long-range dependencies crucial for color correction across entire images. A PatchGAN discriminator provided adversarial training to ensure high-frequency detail preservation. We trained and evaluated our model on the EUVP dataset, which contains paired underwater images of varying quality. Quantitative results demonstrate stateof-the-art performance with PSNR of 24.76 dB and SSIM of 0.89, representing significant improvements over existing methods. Visual results showed effective color balance restoration, contrast improvement, and haze reduction. An ablation study confirms the superiority of our Swin Transformer designed over convolutional alternatives. The proposed method offers robust underwater image reconstruction suitable for various marine applications.

图像修复Transformer水下成像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。