通过自适应选波段与跨源融合,提升多源遥感图像分类精度与效率。
Representative Spectral Correlation Network for Multi-source Remote Sensing Image Classification

- 自适应选择关键波段,减少高维光谱冗余。
- 跨源注意力加权与上下文优化,增强异源特征交互。
- 在多个数据集上超越现有方法,计算开销更低。
高光谱图像(HSI)与SAR/LiDAR数据能提供互补的光谱与结构信息,用于土地覆盖分类。然而,由于高维HSI中的光谱冗余以及多源数据间的异质性,其有效融合仍具挑战。为此,本文提出代表性的光谱相关网络(RSCNet),通过光谱选择与自适应交互解决上述问题。网络包含两个核心组件:(1) 关键波段选择模块(KBSM),在跨源引导下自适应选择原始HSI中任务相关的波段,缓解冗余并减少传统PCA降维导致的信息损失;所选波段具有强判别性光谱结构,与语义线索高度对齐,生成紧凑而表达性强的表示。(2) 跨源自适应融合模块(CAFM),通过跨源注意力加权与局部-全局上下文优化,增强跨源特征交互。在三个公开基准数据集上的实验表明,RSCNet相比现有最优方法取得更优性能,同时计算复杂度显著降低。代码已开源:https://github.com/oucailab/RSCNet。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) and SAR/LiDAR data offer complementary spectral and structural information for land-cover classification. However, their effective fusion remains challenging due to two major limitations: The spectral redundancy in high-dimensional HSI and the heterogeneous characteristics between multi-source data. To this end, we propose Representative Spectral Correlation Network (RSCNet), a novel multi-source image classification framework specifically designed to address the above challenges through spectral selection and adaptive interaction. The network incorporates two key components: (1) Key Band Selection Module (KBSM) that adaptively selects task-relevant spectral bands from the original HSI under cross-source guidance, thereby alleviating redundancy and mitigating information loss from conventional PCA-based spectral reduction. Moreover, the learned band subset exhibits highly discriminative spectral structures that align with discriminative semantic cues, promoting compact yet expressive representations. (2) Cross-source Adaptive Fusion Module (CAFM) that performs cross-source attention weighting and local-global contextual refinement to enhance cross-source feature interaction. Experiments on three public benchmark datasets demonstrate that our RSCNet achieves superior performance compared with state-of-the-art methods, while maintaining substantially lower computational complexity. Our codes are publicly available at https://github.com/oucailab/RSCNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。