提出可直接处理高光谱数据的快速准确模型,支持星上实时分析。
HyperspectralViTs: General Hyperspectral Models for On-board Remote Sensing
- 设计无需手工特征或波段压缩的通用高光谱模型架构。
- 在甲烷检测任务中提升F1分数27%(合成数据)和13%(真实数据)。
- 适合需要星上实时处理的遥感应用,如矿物识别与气体监测。
基于机器学习的星上高光谱数据处理可为甲烷检测、矿物识别等任务带来前所未有的自主性,支持早期预警及卫星星座自动化调度。传统方法误报率高,先前深度学习模型计算开销过大。本文提出高效且准确的机器学习架构,可在不依赖人工特征提取或光谱波段压缩预处理的前提下,实现高维光谱数据的端到端训练。我们在两个高光谱处理任务上评估模型表现:在新构建的合成甲烷检测数据集上,相比此前最优模型,F1得分提升27%;在已有大型基准数据集上提升13%。此外,在合成数据上训练的模型,微调至真实事件数据集后,F1得分比从头训练高出6.9%。在新创建的矿物识别数据集上,模型相较默认版本提升3.5%的F1得分。通过去除对经典特征依赖,推理速度较以往方法提升85%。使用模拟ION-SCV 004卫星的硬件环境,单次EMIT传感器采集数据可在30秒内完成处理。
原文摘要 · Abstract (English)
On-board processing of hyperspectral data with machine learning models would enable unprecedented amount of autonomy for a wide range of tasks, for example methane detection or mineral identification. This can enable early warning system and could allow new capabilities such as automated scheduling across constellations of satellites. Classical methods suffer from high false positive rates and previous deep learning models exhibit prohibitive computational requirements. We propose fast and accurate machine learning architectures which support end-to-end training with data of high spectral dimension without relying on hand-crafted products or spectral band compression preprocessing. We evaluate our models on two tasks related to hyperspectral data processing. With our proposed general architectures, we improve the F1 score of the previous methane detection state-of-the-art models by 27% on a newly created synthetic dataset and by 13% on the previously released large benchmark dataset. We also demonstrate that training models on the synthetic dataset improves performance of models finetuned on the dataset of real events by 6.9% in F1 score in contrast with training from scratch. On a newly created dataset for mineral identification, our models provide 3.5% improvement in the F1 score in contrast to the default versions of the models. With our proposed models we improve the inference speed by 85% in contrast to previous classical and deep learning approaches by removing the dependency on classically computed features. With our architecture, one capture from the EMIT sensor can be processed within 30 seconds on realistic proxy of the ION-SCV 004 satellite.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。