arXiv:2411.18296cs.CV2024-11IJCV被引 39

提升水下图像质量并兼顾下游任务,实现视觉与应用双重优化

HUPE: Heuristic Underwater Perceptual Enhancement with Semantic Collaborative Learning

  • 设计可逆网络,结合傅里叶变换建立水下与清晰图像双向映射
  • 引入启发式先验,更准确捕捉场景信息,提升特征表达能力
  • 通过语义协同学习,使增强图像同时满足视觉美观与任务需求

水下图像常因光线折射和吸收导致能见度降低,影响后续应用。现有增强方法多关注视觉质量,忽视实际应用价值。为此,我们提出一种启发式可逆网络 HUPE,兼顾视觉质量与下游任务需求。该方法采用嵌入傅里叶变换的信息保全可逆变换,建立水下图像与清晰图像间的双向映射;引入启发式先验以更好捕获场景信息;并通过语义协同学习模块,在视觉增强与下游任务联合优化中引导模型提取更具任务导向的语义特征,同时获得视觉上令人满意的图像。大量定量与定性实验表明,HUPE 在多个指标上优于现有先进方法。代码已开源:https://github.com/ZengxiZhang/HUPE。

原文摘要 · Abstract (English)

Underwater images are often affected by light refraction and absorption, reducing visibility and interfering with subsequent applications. Existing underwater image enhancement methods primarily focus on improving visual quality while overlooking practical implications. To strike a balance between visual quality and application, we propose a heuristic invertible network for underwater perception enhancement, dubbed HUPE, which enhances visual quality and demonstrates flexibility in handling other downstream tasks. Specifically, we introduced an information-preserving reversible transformation with embedded Fourier transform to establish a bidirectional mapping between underwater images and their clear images. Additionally, a heuristic prior is incorporated into the enhancement process to better capture scene information. To further bridge the feature gap between vision-based enhancement images and application-oriented images, a semantic collaborative learning module is applied in the joint optimization process of the visual enhancement task and the downstream task, which guides the proposed enhancement model to extract more task-oriented semantic features while obtaining visually pleasing images. Extensive experiments, both quantitative and qualitative, demonstrate the superiority of our HUPE over state-of-the-art methods. The source code is available at https://github.com/ZengxiZhang/HUPE.

水下图像增强可逆网络语义协同学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。