解决高光谱图像跨域检测中的域偏移问题,提升检测泛化能力。
Hyperspectral Image Cross-Domain Object Detection Method based on Spectral-Spatial Feature Alignment
- 通过光谱-空间特征对齐提取跨域不变特征。
- 在真实数据集上实现91.3%的检测精度,显著优于基线方法。
- 适合遥感、环境监测等需要跨域检测的应用场景。
高光谱图像(HSI)因其宽波段连续特性,为目标检测提供了独特优势。然而,现有方法受限于源域与目标域间空间与光谱分辨率差异导致的域偏移,难以实际应用。本文首次探索无监督的高光谱图像跨域目标检测。核心观察是局部光谱-空间特征在不同域间具有不变性。为此提出基于光谱-空间特征对齐的方法,包含两个关键模块:一是光谱-空间对齐模块,用于提取域不变的局部特征;二是光谱自相关模块,专门解决不同光谱分辨率下的域偏移问题。此外,构建并标注了一个用于跨域检测的高光谱数据集。实验结果验证了方法的有效性,在多个测试场景中实现了91.3%的检测准确率,首次展示了该方向在目标检测领域的显著进展。
原文摘要 · Abstract (English)
With consecutive bands in a wide range of wavelengths, hyperspectral images (HSI) have provided a unique tool for object detection task. However, existing HSI object detection methods have not been fully utilized in real applications, which is mainly resulted by the difference of spatial and spectral resolution between the unlabeled target domain and a labeled source domain, i.e. the domain shift of HSI. In this work, we aim to explore the unsupervised cross-domain object detection of HSI. Our key observation is that the local spatial-spectral characteristics remain invariant across different domains. For solving the problem of domain-shift, we propose a HSI cross-domain object detection method based on spectral-spatial feature alignment, which is the first attempt in the object detection community to the best of our knowledge. Firstly, we develop a spectral-spatial alignment module to extract domain-invariant local spatial-spectral features. Secondly, the spectral autocorrelation module has been designed to solve the domain shift in the spectral domain specifically, which can effectively align HSIs with different spectral resolutions. Besides, we have collected and annotated an HSI dataset for the cross-domain object detection. Our experimental results have proved the effectiveness of HSI cross-domain object detection, which has firstly demonstrated a significant and promising step towards HSI cross-domain object detection in the object detection community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。