arXiv:2412.07009cs.CV2024-12被引 11

提出轻量级模型同步增强水下图像并检测目标,提升准确率与效率。

LUIEO: A Lightweight Model for Integrating Underwater Image Enhancement and Object Detection

  • 多任务学习动态共享图像增强与目标检测特征
  • 在真实水下图像上实现检测精度显著提升
  • 适合水下视觉系统开发与实时检测场景

水下光学图像常受模糊、低对比度和色彩失真等退化因素影响,阻碍目标检测精度。由于缺乏配对的水下/清晰图像,现有方法多采用先增强后检测策略,导致两任务间特征无法交互。同时,水下退化因素多样且样本有限,现有增强方法难以有效处理未知水域图像,制约检测性能提升。多数检测结果仍基于退化图像,难以直观判断正确性。为此,本文提出一种多任务学习框架,同步进行水下图像增强与目标检测。相比单任务学习,该集成模型可动态调整任务间信息交互。鉴于真实水下图像仅提供目标标注,本文引入物理约束,确保检测任务不干扰增强任务。具体通过物理模块将水下图像分解为清晰图像、背景光和透射图,并利用物理模型实现自监督。数值实验表明,所提模型在视觉效果、检测精度与效率方面均优于当前先进方法。

原文摘要 · Abstract (English)

Underwater optical images inevitably suffer from various degradation factors such as blurring, low contrast, and color distortion, which hinder the accuracy of object detection tasks. Due to the lack of paired underwater/clean images, most research methods adopt a strategy of first enhancing and then detecting, resulting in a lack of feature communication between the two learning tasks. On the other hand, due to the contradiction between the diverse degradation factors of underwater images and the limited number of samples, existing underwater enhancement methods are difficult to effectively enhance degraded images of unknown water bodies, thereby limiting the improvement of object detection accuracy. Therefore, most underwater target detection results are still displayed on degraded images, making it difficult to visually judge the correctness of the detection results. To address the above issues, this paper proposes a multi-task learning method that simultaneously enhances underwater images and improves detection accuracy. Compared with single-task learning, the integrated model allows for the dynamic adjustment of information communication and sharing between different tasks. Due to the fact that real underwater images can only provide annotated object labels, this paper introduces physical constraints to ensure that object detection tasks do not interfere with image enhancement tasks. Therefore, this article introduces a physical module to decompose underwater images into clean images, background light, and transmission images and uses a physical model to calculate underwater images for self-supervision. Numerical experiments demonstrate that the proposed model achieves satisfactory results in visual performance, object detection accuracy, and detection efficiency compared to state-of-the-art comparative methods.

水下图像多任务学习目标检测图像增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。