HyperFM高效建模遥感光谱数据,提升云属性反演精度。
HyperFM: An Efficient Hyperspectral Foundation Model with Spectral Grouping

- 采用光谱分组注意力与混合参数分解,降低计算开销。
- 在四个大气云属性任务中优于现有模型与主流方法。
- 适配多场景光谱数据,助力遥感智能分析落地应用。
NASA的PACE任务提供了前所未有的海洋颜色、气溶胶和云的高光谱观测,揭示了这些成分如何相互作用并影响地球气候与空气质量。其海洋颜色仪在数百个精细间隔的波长波段上测量光线,可详细表征浮游生物组成、气溶胶特性及云微物理。然而,此类高光谱数据体量大、结构复杂且标注困难,需专用处理技术。现有基础模型多基于标准RGB图像训练,难以解析PACE捕捉的连续光谱特征。尽管近年出现高光谱基础模型,但通常仅在无云数据上训练,且受限于单传感器数据因仪器光谱不一致问题。此外,多数模型参数量大、计算成本高,难于实际部署。为此,本文提出HyperFM,一种参数高效的高光谱基础模型,通过组内与组间光谱注意力及混合参数分解,更优地捕捉光谱空间关系并降低计算成本。HyperFM在四个基准下游大气云属性反演任务中持续超越现有高光谱基础模型及任务特定最先进方法。为支持进一步研究,我们还发布了由PACE任务生成的大型高光谱数据集HyperFM250K,涵盖晴空与云景场景。
原文摘要 · Abstract (English)
The NASA PACE mission provides unprecedented hyperspectral observations of ocean color, aerosols, and clouds, offering new insights into how these components interact and influence Earth's climate and air quality. Its Ocean Color Instrument measures light across hundreds of finely spaced wavelength bands, enabling detailed characterization of features such as phytoplankton composition, aerosol properties, and cloud microphysics. However, hyperspectral data of this scale is large, complex, and difficult to label, requiring specialized processing and analysis techniques. Existing foundation models, which have transformed computer vision and natural language processing, are generally trained on standard RGB imagery and therefore struggle to interpret the continuous spectral signatures captured by PACE. While recent advances have introduced hyperspectral foundation models, they are typically trained on cloud-free observations and often remain limited to single-sensor datasets due to spectral inconsistencies across instruments. Moreover, existing models tend to be parameter-heavy and computationally expensive, limiting scalability and adoption in operational settings. To address these challenges, we introduce HyperFM, a parameter-efficient hyperspectral foundation model that leverages intra-group and inter-group spectral attention along with hybrid parameter decomposition to better capture spectral spatial relationships while reducing computational cost. HyperFM demonstrates consistent performance improvements over existing hyperspectral foundation models and task-specific state-of-the-art methods across four benchmark downstream atmospheric cloud property retrieval tasks. To support further research, we additionally release HyperFM250K, a large-scale hyperspectral dataset from the PACE mission that includes both clear and cloudy scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。