通过预测光谱顺序提升土壤有机碳估算,性能超越现有方法。
SpecBPP: A Self-Supervised Learning Approach for Hyperspectral Representation and Soil Organic Carbon Estimation
- 用光谱段重排序作为自监督任务,学习全局光谱结构。
- 在有限标注下实现R²=0.9456,RMSE=1.1053%,RPD=4.19。
- 适合遥感、土壤分析等需要小样本高精度建模的场景。
自监督学习在视觉和语言领域已取得突破,但在高光谱影像(HSI)中仍较少应用,而光谱波段的序列特性提供了独特机会。本文提出光谱带排列预测(SpecBPP),一种新颖的自监督学习框架,利用高光谱影像的固有光谱连续性。不同于掩码波段重建,SpecBPP要求模型恢复被打乱的光谱段顺序,从而促进对全局光谱结构的理解。我们采用基于课程的学习策略,逐步增加排列难度以应对排列空间的阶乘复杂性。在使用EnMAP卫星数据进行土壤有机碳(SOC)估算时,该方法达到当前最优结果,显著优于掩码自编码器(MAE)和联合嵌入预测(JEPA)基线。在少量标注样本微调后,模型取得R²=0.9456、RMSE=1.1053%、RPD=4.19的性能,大幅超越传统与自监督方法。结果表明,光谱顺序预测是高光谱理解的强大预训练任务,为遥感及其他科学领域的表示学习开辟新路径。
原文摘要 · Abstract (English)
Self-supervised learning has revolutionized representation learning in vision and language, but remains underexplored for hyperspectral imagery (HSI), where the sequential structure of spectral bands offers unique opportunities. In this work, we propose Spectral Band Permutation Prediction (SpecBPP), a novel self-supervised learning framework that leverages the inherent spectral continuity in HSI. Instead of reconstructing masked bands, SpecBPP challenges a model to recover the correct order of shuffled spectral segments, encouraging global spectral understanding. We implement a curriculum-based training strategy that progressively increases permutation difficulty to manage the factorial complexity of the permutation space. Applied to Soil Organic Carbon (SOC) estimation using EnMAP satellite data, our method achieves state-of-the-art results, outperforming both masked autoencoder (MAE) and joint-embedding predictive (JEPA) baselines. Fine-tuned on limited labeled samples, our model yields an $R^2$ of 0.9456, RMSE of 1.1053%, and RPD of 4.19, significantly surpassing traditional and self-supervised benchmarks. Our results demonstrate that spectral order prediction is a powerful pretext task for hyperspectral understanding, opening new avenues for scientific representation learning in remote sensing and beyond.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。