水下图像增强能提升单张图像检测效果,但整体数据集性能反而下降。
Beneath the Surface: The Role of Underwater Image Enhancement in Object Detection
- 对比9种增强模型在两个数据集上的表现
- 整体检测准确率下降,但个别图像检测变好
- 建议按图像级选择性使用增强技术
水下图像常因严重退化导致视觉质量差和目标检测性能下降。本文评估了9种最新水下图像增强模型,涵盖物理、非物理和基于学习的方法,应用于两个近期水下图像数据集。通过定性和定量分析原始与增强图像,发现两类分析结果存在差异,并揭示了增强后图像质量分布的变化。随后在原始数据集上训练三个主流目标检测模型,选取最优检测器进一步分析;该检测器在增强数据集上重新训练,结果显示增强对整体数据集的检测性能产生负面影响。进一步相关性研究显示,多种增强指标与平均精度(mAP)无显著正相关。最后的图像级分析表明,部分图像经增强后检测性能确实提升。研究揭示了图像增强在个体图像层面改善检测的潜力,提示应避免对整个数据集统一增强,而应按需选择性应用。相关数据、代码及补充材料已公开于:https://github.com/RSSL-MTU/Enhancement-Detection-Analysis。
原文摘要 · Abstract (English)
Underwater imagery often suffers from severe degradation resulting in low visual quality and reduced object detection performance. This work aims to evaluate state-of-the-art image enhancement models, investigate their effects on underwater object detection, and explore their potential to improve detection performance. To this end, we apply nine recent underwater image enhancement models, covering physical, non-physical and learning-based categories, to two recent underwater image datasets. Following this, we conduct joint qualitative and quantitative analyses on the original and enhanced images, revealing the discrepancy between the two analyses, and analyzing changes in the quality distribution of the images after enhancement. We then train three recent object detection models on the original datasets, selecting the best-performing detector for further analysis. This detector is subsequently re-trained on the enhanced datasets to evaluate changes in detection performance, highlighting the adverse effect of enhancement on detection performance at the dataset level. Next, we perform a correlation study to examine the relationship between various enhancement metrics and the mean Average Precision (mAP). Finally, we conduct an image-level analysis that reveals images of improved detection performance after enhancement. The findings of this study demonstrate the potential of image enhancement to improve detection performance and provide valuable insights for researchers to further explore the effects of enhancement on detection at the individual image level, rather than at the dataset level. This could enable the selective application of enhancement for improved detection. The data generated, code developed, and supplementary materials are publicly available at: https://github.com/RSSL-MTU/Enhancement-Detection-Analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。