用光谱序列建模实现无需时空信息的精准云检测
SpecTf: Transformers Enable Data-Driven Imaging Spectroscopy Cloud Detection
- 将光谱数据当序列处理,学习物理规律而不依赖空间上下文
- 在EMIT数据上性能超越现有基线,参数量少一个数量级
- 注意力机制可解释,且跨仪器无修改适配成功
当前及未来的可见光-短波红外成像光谱仪有望在全球范围内前所未有地量化地球系统过程。然而,可靠云筛查仍是这些仪器面临的根本挑战,传统空间和时间方法受限于云的多样性及有限的时间覆盖。光谱变换器(SpecTf)通过一种专为光谱设计的深度学习架构解决了这一问题,仅使用光谱信息即可完成云检测(无需空间或时间数据)。通过将光谱测量视为序列而非图像通道,SpecTf在不依赖空间上下文的情况下学习基本物理关系。实验表明,SpecTf显著优于当前用于EMIT仪器的基线方法,且在参数量少一个数量级的情况下表现媲美其他机器学习方法。关键的是,我们通过注意力机制展示了SpecTf的内在可解释性,揭示了模型学到的具有物理意义的光谱特征。最后,我们展示了SpecTf跨仪器泛化潜力——在不同平台的不同仪器上无修改应用成功,为未来成像光谱任务的仪器无关数据驱动算法开辟了道路。
原文摘要 · Abstract (English)
Current and upcoming generations of visible-shortwave infrared (VSWIR) imaging spectrometers promise unprecedented capacity to quantify Earth System processes across the globe. However, reliable cloud screening remains a fundamental challenge for these instruments, where traditional spatial and temporal approaches are limited by cloud variability and limited temporal coverage. The Spectroscopic Transformer (SpecTf) addresses these challenges with a spectroscopy-specific deep learning architecture that performs cloud detection using only spectral information (no spatial or temporal data are required). By treating spectral measurements as sequences rather than image channels, SpecTf learns fundamental physical relationships without relying on spatial context. Our experiments demonstrate that SpecTf significantly outperforms the current baseline approach implemented for the EMIT instrument, and performs comparably with other machine learning methods with orders of magnitude fewer learned parameters. Critically, we demonstrate SpecTf's inherent interpretability through its attention mechanism, revealing physically meaningful spectral features the model has learned. Finally, we present SpecTf's potential for cross-instrument generalization by applying it to a different instrument on a different platform without modifications, opening the door to instrument agnostic data driven algorithms for future imaging spectroscopy tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。