针对高光谱图像域泛化,提出基于光谱特性的增强方法提升模型鲁棒性。
Spectral Property-Driven Data Augmentation for Hyperspectral Single-Source Domain Generalization
- 根据高光谱数据的通道数变化和相邻通道混合特性设计增强策略
- 在三个遥感数据集上优于现有最先进方法,显著提升跨域分类性能
- 适合需要处理传感器差异的高光谱遥感图像分析任务
高光谱图像(HSI)虽拥有丰富光谱通道信息,但维度增加与传感器差异使其对跨域分布偏移更敏感,影响分类性能。为应对这一问题,高光谱单源域泛化(SDG)常采用数据增强模拟域偏移以提升模型鲁棒性。然而,盲目增强可能生成不符合现实的样本,过度强调真实性又会抑制多样性,导致真实性和多样性之间的权衡限制了模型泛化能力。为此,本文提出光谱特性驱动的数据增强(SPDDA),显式考虑高光谱数据的固有属性:设备相关的光谱通道数量变化及相邻通道混合。具体而言,SPDDA设计光谱多样性模块,沿光谱维度重采样源域数据生成不同通道数的样本,并通过建模通道间相似性构建通道自适应光谱混合器,避免固定增强模式。为进一步提升增强样本的真实性,提出时空协同优化机制,联合优化空间保真度约束与光谱连续性自约束,且自适应调整光谱自约束权重,防止光谱维度过平滑,保持空间结构。在三个遥感基准数据集上的大量实验表明,SPDDA优于现有最先进方法。
原文摘要 · Abstract (English)
While hyperspectral images (HSI) benefit from numerous spectral channels that provide rich information for classification, the increased dimensionality and sensor variability make them more sensitive to distributional discrepancies across domains, which in turn can affect classification performance. To tackle this issue, hyperspectral single-source domain generalization (SDG) typically employs data augmentation to simulate potential domain shifts and enhance model robustness under the condition of single-source domain training data availability. However, blind augmentation may produce samples misaligned with real-world scenarios, while excessive emphasis on realism can suppress diversity, highlighting a tradeoff between realism and diversity that limits generalization to target domains. To address this challenge, we propose a spectral property-driven data augmentation (SPDDA) that explicitly accounts for the inherent properties of HSI, namely the device-dependent variation in the number of spectral channels and the mixing of adjacent channels. Specifically, SPDDA employs a spectral diversity module that resamples data from the source domain along the spectral dimension to generate samples with varying spectral channels, and constructs a channel-wise adaptive spectral mixer by modeling inter-channel similarity, thereby avoiding fixed augmentation patterns. To further enhance the realism of the augmented samples, we propose a spatial-spectral co-optimization mechanism, which jointly optimizes a spatial fidelity constraint and a spectral continuity self-constraint. Moreover, the weight of the spectral self-constraint is adaptively adjusted based on the spatial counterpart, thus preventing over-smoothing in the spectral dimension and preserving spatial structure. Extensive experiments conducted on three remote sensing benchmarks demonstrate that SPDDA outperforms state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。