DIVER提升水下图像质量,增强机器人感知能力。
Development of Domain-Invariant Visual Enhancement and Restoration (DIVER) Approach for Underwater Images
- 融合物理模型与自适应算法,实现无监督水下图像增强。
- 在8个数据集上均优于现有方法,色度恢复提升4.9%以上。
- 特别适合深水、浑浊或人工光照复杂场景的机器人应用。
水下图像因波长相关衰减、散射和光照不均而严重退化,且随水体类型和深度变化显著。本文提出一种无监督的域不变视觉增强与复原框架DIVER,结合经验校正与物理引导建模,实现鲁棒的水下图像增强。DIVER首先采用IlluminateNet进行自适应亮度增强,或使用光谱均衡滤波器实现光谱归一化;随后通过通道自适应滤波的自适应光学修正模块优化色调与对比度;再由受物理约束学习的Hydro-OpticNet补偿后向散射和波长依赖性衰减。IlluminateNet与Hydro-OpticNet参数通过复合损失函数的无监督学习进行优化。DIVER在包含浅水、深水及高浊度环境的八个多样化数据集上评估,涵盖自然低光与人工照明场景,使用参考与非参考指标。尽管当前先进方法如WaterNet、UDNet和Phaseformer在浅水表现良好,但在深水、光照不均或人工照明条件下性能下降。相比之下,DIVER在所有数据集上持续达到最佳或接近最佳表现,展现出强域不变能力。在UCIQE指标上,其性能至少比现有方法提升9%;在低光SeaThru数据集上,颜色还原误差(GPMAE)降低至少4.9%。此外,DIVER显著提升基于ORB的关键点重复率与匹配性能,验证其在多样水下环境中的鲁棒性。
原文摘要 · Abstract (English)
Underwater images suffer severe degradation due to wavelength-dependent attenuation, scattering, and illumination non-uniformity that vary across water types and depths. We propose an unsupervised Domain-Invariant Visual Enhancement and Restoration (DIVER) framework that integrates empirical correction with physics-guided modeling for robust underwater image enhancement. DIVER first applies either IlluminateNet for adaptive luminance enhancement or a Spectral Equalization Filter for spectral normalization. An Adaptive Optical Correction Module then refines hue and contrast using channel-adaptive filtering, while Hydro-OpticNet employs physics-constrained learning to compensate for backscatter and wavelength-dependent attenuation. The parameters of IlluminateNet and Hydro-OpticNet are optimized via unsupervised learning using a composite loss function. DIVER is evaluated on eight diverse datasets covering shallow, deep, and highly turbid environments, including both naturally low-light and artificially illuminated scenes, using reference and non-reference metrics. While state-of-the-art methods such as WaterNet, UDNet, and Phaseformer perform reasonably in shallow water, their performance degrades in deep, unevenly illuminated, or artificially lit conditions. In contrast, DIVER consistently achieves best or near-best performance across all datasets, demonstrating strong domain-invariant capability. DIVER yields at least a 9% improvement over SOTA methods in UCIQE. On the low-light SeaThru dataset, where color-palette references enable direct evaluation of color restoration, DIVER achieves at least a 4.9% reduction in GPMAE compared to existing methods. Beyond visual quality, DIVER also improves robotic perception by enhancing ORB-based keypoint repeatability and matching performance, confirming its robustness across diverse underwater environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。