arXiv:2509.13229cs.CVcs.AI2025-09中稿 · ICRA被引 1

用课程学习提升轻量模型,让卫星实时处理高光谱图像。

Curriculum Multi-Task Self-Supervision Improves Lightweight Architectures for Onboard Satellite Hyperspectral Image Segmentation

  • 设计课程式多任务自监督框架,分步提升训练难度。
  • 轻量模型比顶尖模型小16000倍,分割精度仍领先。
  • 适合资源受限的星载系统,通用性强。

高光谱成像(HSI)通过每像素数百个连续波段捕捉精细光谱特征,对地表分类、变化检测和环境监测至关重要。由于HSI数据维度高且卫星系统数据传输速率慢,需紧凑高效的模型实现星上处理并减少冗余数据传输。为此,我们提出一种针对轻量级架构的课程式多任务自监督学习(CMTSSL)框架。CMTSSL融合掩码图像建模与解耦的空间-光谱拼图求解,通过课程学习策略逐步提升自监督训练难度,使编码器联合捕捉细粒度光谱连续性、空间结构和全局语义特征。相比以往双任务自监督方法,CMTSSL在统一高效设计中同时解决空间与光谱推理,特别适合星载轻量模型训练。我们在四个公开基准数据集上验证该方法,下游分割任务持续提升性能,所用模型比部分先进模型轻16,000倍以上。结果表明CMTSSL在真实世界高光谱应用中具有强大泛化表示学习潜力。代码已开源:https://github.com/hugocarlesso/CMTSSL。

原文摘要 · Abstract (English)

Hyperspectral imaging (HSI) captures detailed spectral signatures across hundreds of contiguous bands per pixel, being indispensable for remote sensing applications such as land-cover classification, change detection, and environmental monitoring. Due to the high dimensionality of HSI data and the slow rate of data transfer in satellite-based systems, compact and efficient models are required to support onboard processing and minimize the transmission of redundant or low-value data. To this end, we introduce a novel curriculum multi-task self-supervised learning (CMTSSL) framework designed for lightweight architectures for HSI analysis. CMTSSL integrates masked image modeling with decoupled spatial and spectral jigsaw puzzle solving, guided by a curriculum learning strategy that progressively increases data difficulty during self-supervision. This enables the encoder to jointly capture fine-grained spectral continuity, spatial structure, and global semantic features. Unlike prior dual-task SSL methods, CMTSSL simultaneously addresses spatial and spectral reasoning within a unified and computationally efficient design, being particularly suitable for training lightweight models for onboard satellite deployment. We validate our approach on four public benchmark datasets, demonstrating consistent gains in downstream segmentation tasks, using architectures that are over 16,000x lighter than some state-of-the-art models. These results highlight the potential of CMTSSL in generalizable representation learning with lightweight architectures for real-world HSI applications. Our code is publicly available at https://github.com/hugocarlesso/CMTSSL.

高光谱轻量模型自监督星载计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。