arXiv:2412.18112cs.CV2024-12中稿 · IEEE TIM被引 9

用点标注实现高光谱图像显著性检测,精度媲美全像素标注。

Spectrum-oriented Point-supervised Saliency Detector for Hyperspectral Images

  • 引入光谱显著性作为关键特征,结合点监督生成伪标签。
  • 在HSOD-BIT数据集上MAE达0.031,F-measure达0.878。
  • 适合标注成本高的高光谱图像场景,通用性强。

高光谱显著性目标检测(HSOD)旨在从高光谱图像中提取光谱差异显著的目标或区域。现有深度学习方法虽表现良好,但普遍依赖像素级标注,而高光谱图像的标注极为困难。为此,本文将点监督引入HSOD,将传统方法中的光谱显著性作为核心光谱表示融入框架,提出一种新型光谱导向点监督显著性检测器(SPSD)。针对点监督导致性能下降的问题,设计专用于高光谱图像的伪标签生成流程,有效缓解该问题。同时,利用光谱显著性对抗模型监督与显著性优化过程中的信息丢失,保持目标结构完整性和边缘精度。此外,引入光谱变换空间门,更精准聚焦显著区域,减少特征冗余。在HSOD-BIT和HS-SOD数据集上进行充分实验,采用平均绝对误差(MAE)、E-measure、F-measure、曲线下面积(AUC)及交叉相关性(CC)等指标评估。例如,在HSOD-BIT数据集上,SPSD取得MAE为0.031、F-measure为0.878的性能。消融实验验证了各模块有效性,并揭示模型工作机制。在RGB-热成像显著性检测数据集上的进一步评估也展示了方法的泛化能力。

原文摘要 · Abstract (English)

Hyperspectral salient object detection (HSOD) aims to extract targets or regions with significantly different spectra from hyperspectral images. While existing deep learning-based methods can achieve good detection results, they generally necessitate pixel-level annotations, which are notably challenging to acquire for hyperspectral images. To address this issue, we introduce point supervision into HSOD, and incorporate Spectral Saliency, derived from conventional HSOD methods, as a pivotal spectral representation within the framework. This integration leads to the development of a novel Spectrum-oriented Point-supervised Saliency Detector (SPSD). Specifically, we propose a novel pipeline, specifically designed for HSIs, to generate pseudo-labels, effectively mitigating the performance decline associated with point supervision strategy. Additionally, Spectral Saliency is employed to counteract information loss during model supervision and saliency refinement, thereby maintaining the structural integrity and edge accuracy of the detected objects. Furthermore, we introduce a Spectrum-transformed Spatial Gate to focus more precisely on salient regions while reducing feature redundancy. We have carried out comprehensive experiments on both HSOD-BIT and HS-SOD datasets to validate the efficacy of our proposed method, using mean absolute error (MAE), E-measure, F-measure, Area Under Curve, and Cross Correlation as evaluation metrics. For instance, on the HSOD-BIT dataset, our SPSD achieves a MAE of 0.031 and an F-measure of 0.878. Thorough ablation studies have substantiated the effectiveness of each individual module and provided insights into the model's working mechanism. Further evaluations on RGB-thermal salient object detection datasets highlight the versatility of our approach.

高光谱显著性检测点监督伪标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。