arXiv:2412.03995cs.CVcs.LG2024-12被引 1

用协作回归网络提升水下图像恢复质量,效果超越真实图像。

Blind Underwater Image Restoration using Co-Operational Regressor Networks

  • 设计双网络协作模型,一个负责修复图像,一个评估并反馈质量
  • 在LSUI数据集上达到当前最佳性能,两轮处理后甚至优于真实图像
  • 基于自组织神经网络,计算复杂度低,适合实际应用

水下环境探索对生物研究、考古和基础设施维护至关重要,但水体的散射、吸收、色彩失真和能见度降低使成像极具挑战。尽管已有多种信号处理与深度学习方法,但尚未有统一有效方案。本文提出新型机器学习模型Co-Operational Regressor Networks(CoRe-Nets),由负责图像转换的学徒回归器(AR)与评估生成图像峰值信噪比(PSNR)并反馈给AR的主回归器(MR)协同工作。模型基于自组织操作神经网络(Self-ONNs),通过调节核变换中的非线性实现更强学习能力。在基准大型水下图像(LSUI)数据集上验证,双网络联合学习显著提升恢复效果,计算开销更低,且两轮处理后常优于真实图像视觉质量。代码已开源于GitHub。

原文摘要 · Abstract (English)

The exploration of underwater environments is essential for applications such as biological research, archaeology, and infrastructure maintenanceHowever, underwater imaging is challenging due to the waters unique properties, including scattering, absorption, color distortion, and reduced visibility. To address such visual degradations, a variety of approaches have been proposed covering from basic signal processing methods to deep learning models; however, none of them has proven to be consistently successful. In this paper, we propose a novel machine learning model, Co-Operational Regressor Networks (CoRe-Nets), designed to achieve the best possible underwater image restoration. A CoRe-Net consists of two co-operating networks: the Apprentice Regressor (AR), responsible for image transformation, and the Master Regressor (MR), which evaluates the Peak Signal-to-Noise Ratio (PSNR) of the images generated by the AR and feeds it back to AR. CoRe-Nets are built on Self-Organized Operational Neural Networks (Self-ONNs), which offer a superior learning capability by modulating nonlinearity in kernel transformations. The effectiveness of the proposed model is demonstrated on the benchmark Large Scale Underwater Image (LSUI) dataset. Leveraging the joint learning capabilities of the two cooperating networks, the proposed model achieves the state-of-art restoration performance with significantly reduced computational complexity and often presents such results that can even surpass the visual quality of the ground truth with a 2-pass application. Our results and the optimized PyTorch implementation of the proposed approach are now publicly shared on GitHub.

图像恢复水下成像双网络自组织网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。