在卫星上快速微调分割模型,实现灾害实时响应。
Rapid Distributed Fine-tuning of a Segmentation Model Onboard Satellites
- 采用分布式方式在多颗卫星上快速微调轻量级分割模型。
- 仅用少量数据和快速通信即可提升水体分割精度。
- 适合需要快速响应的灾害监测场景,如极端天气事件。
地球观测(EO)卫星数据的分割对自然灾害分析与应急响应至关重要。然而,在地面站处理数据会因传输瓶颈和通信窗口限制导致延迟。在卫星上部署近实时分析的分割模型可显著提升响应速度。本研究以轻量级预训练模型MobileSAM为基础,集成至Unibap iX10-100卫星硬件平台,并通过PASEOS开源模块模拟卫星运行环境,验证其在卫星星座中的表现。实验基于哨兵-2影像完成水体分割,探索在灾害发生时,多颗卫星通过去中心化学习快速微调模型的可行性。结果表明,在模拟轨道环境下,即使通信频繁且数据量小,模型仍能快速收敛并提升分割性能。该工作推动了星载AI的发展,强调了预训练模型去中心化微调在快速响应场景中的价值。随着极端天气事件频发,星上即时数据分析变得愈发关键。
原文摘要 · Abstract (English)
Segmentation of Earth observation (EO) satellite data is critical for natural hazard analysis and disaster response. However, processing EO data at ground stations introduces delays due to data transmission bottlenecks and communication windows. Using segmentation models capable of near-real-time data analysis onboard satellites can therefore improve response times. This study presents a proof-of-concept using MobileSAM, a lightweight, pre-trained segmentation model, onboard Unibap iX10-100 satellite hardware. We demonstrate the segmentation of water bodies from Sentinel-2 satellite imagery and integrate MobileSAM with PASEOS, an open-source Python module that simulates satellite operations. This integration allows us to evaluate MobileSAM's performance under simulated conditions of a satellite constellation. Our research investigates the potential of fine-tuning MobileSAM in a decentralised way onboard multiple satellites in rapid response to a disaster. Our findings show that MobileSAM can be rapidly fine-tuned and benefits from decentralised learning, considering the constraints imposed by the simulated orbital environment. We observe improvements in segmentation performance with minimal training data and fast fine-tuning when satellites frequently communicate model updates. This study contributes to the field of onboard AI by emphasising the benefits of decentralised learning and fine-tuning pre-trained models for rapid response scenarios. Our work builds on recent related research at a critical time; as extreme weather events increase in frequency and magnitude, rapid response with onboard data analysis is essential.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。