arXiv:2409.13464cs.CV2024-09

针对压缩图像设计更鲁棒的显著性目标检测方法

Robust Salient Object Detection on Compressed Images Using Convolutional Neural Networks

  • 构建多个压缩图像显著性数据集,系统评估CNN模型表现
  • 发现现有模型在压缩图像上性能大幅下降,关键瓶颈在特征学习
  • 提出鲁棒特征表示基线框架,兼顾压缩与清晰图像效果

近年来显著性目标检测(SOD)取得显著进展。但在实际应用中,压缩图像(CI)是数据传输和存储的主要形式。然而,针对使用卷积神经网络(CNN)进行压缩图像显著性检测的研究仍十分有限。本文致力于严格基准测试并分析基于CNN的压缩图像显著性检测。为全面研究该问题,我们从现有公开的SOD数据集中精心构建了多个压缩图像显著性检测数据集。随后,我们考察了代表性CNN-based SOD方法在约264万张压缩图像上的鲁棒性。重要的是,评估结果揭示两个关键发现:1)当前最先进的基于CNN的SOD模型虽在清晰图像上表现优异,但在压缩图像上存在明显性能瓶颈;2)压缩图像显著性检测的鲁棒性主要受图像压缩特性及显著性特征学习局限性影响。基于此,我们提出一种简单但有前景的基线框架,聚焦于鲁棒特征表示学习,以实现鲁棒的基于CNN的压缩图像显著性检测。大量实验表明,该方法在多种图像退化水平下均展现出显著提升的鲁棒性,同时在清晰图像上保持竞争性精度。我们希望本工作的基准测试、分析洞察与所提技术能推动社区对基于CNN的SOD算法鲁棒性的更全面理解,激发未来研究。

原文摘要 · Abstract (English)

Salient object detection (SOD) has achieved substantial progress in recent years. In practical scenarios, compressed images (CI) serve as the primary medium for data transmission and storage. However, scant attention has been directed towards SOD for compressed images using convolutional neural networks (CNNs). In this paper, we are dedicated to strictly benchmarking and analyzing CNN-based salient object detection on compressed images. To comprehensively study this issue, we meticulously establish various CI SOD datasets from existing public SOD datasets. Subsequently, we investigate representative CNN-based SOD methods, assessing their robustness on compressed images (approximately 2.64 million images). Importantly, our evaluation results reveal two key findings: 1) current state-of-the-art CNN-based SOD models, while excelling on clean images, exhibit significant performance bottlenecks when applied to compressed images. 2) The principal factors influencing the robustness of CI SOD are rooted in the characteristics of compressed images and the limitations in saliency feature learning. Based on these observations, we propose a simple yet promising baseline framework that focuses on robust feature representation learning to achieve robust CNN-based CI SOD. Extensive experiments demonstrate the effectiveness of our approach, showcasing markedly improved robustness across various levels of image degradation, while maintaining competitive accuracy on clean data. We hope that our benchmarking efforts, analytical insights, and proposed techniques will contribute to a more comprehensive understanding of the robustness of CNN-based SOD algorithms, inspiring future research in the community.

显著性检测压缩图像鲁棒性CNN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。