用图像分割思路解决高光谱分类难题,提升精度与边界识别能力。
When Segmentation Meets Hyperspectral Image: New Paradigm for Hyperspectral Image Classification
- 引入动态位移区域注意力机制,增强空间结构感知。
- 在5个公开数据集上超越现有方法,最高提升2.3%准确率。
- 适合关注遥感图像语义分割与高光谱分类的研究者。
高光谱图像(HSI)分类是遥感领域的基石,依赖丰富的光谱信息实现材料与地表覆盖的精确识别。尽管深度学习推动了该任务的显著进展,但超过90%的成果来自小块(如7x7、9x9)分类器,存在局限性:(1)小块采样受制于有限的感受野,导致空间结构信息不足,均匀区域内仍出现噪声类误分类;(2)最优块大小未定义,造成标签预测粗糙,性能下降;(3)缺乏对目标周围多形态特征的感知。为此,我们借鉴大规模图像分割技术在处理对象边界方面的优势,提出新范式与基线模型 HSIseg,结合新型动态位移区域变换器(DSRT)克服上述挑战。同时,设计直观的渐进式学习框架,通过自适应伪标签迭代融合未标注区域,并引入多源数据协同促进特征交互。在五个公开高光谱数据集上的验证表明,本方法优于当前最先进水平。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) classification is a cornerstone of remote sensing, enabling precise material and land-cover identification through rich spectral information. While deep learning has driven significant progress in this task, small patch-based classifiers, which account for over 90% of the progress, face limitations: (1) the small patch (e.g., 7x7, 9x9)-based sampling approach considers a limited receptive field, resulting in insufficient spatial structural information critical for object-level identification and noise-like misclassifications even within uniform regions; (2) undefined optimal patch sizes lead to coarse label predictions, which degrade performance; and (3) a lack of multi-shape awareness around objects. To address these challenges, we draw inspiration from large-scale image segmentation techniques, which excel at handling object boundaries-a capability essential for semantic labeling in HSI classification. However, their application remains under-explored in this task due to (1) the prevailing notion that larger patch sizes degrade performance, (2) the extensive unlabeled regions in HSI groundtruth, and (3) the misalignment of input shapes between HSI data and segmentation models. Thus, in this study, we propose a novel paradigm and baseline, HSIseg, for HSI classification that leverages segmentation techniques combined with a novel Dynamic Shifted Regional Transformer (DSRT) to overcome these challenges. We also introduce an intuitive progressive learning framework with adaptive pseudo-labeling to iteratively incorporate unlabeled regions into the training process, thereby advancing the application of segmentation techniques. Additionally, we incorporate auxiliary data through multi-source data collaboration, promoting better feature interaction. Validated on five public HSI datasets, our proposal outperforms state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。