MOMO首次融合火星多传感器数据,构建跨分辨率遥感基础模型。
MOMO: Mars Orbital Model Foundation Model for Mars Orbital Applications
- 通过等效验证损失策略选择最优检查点,实现多传感器模型融合
- 在1200万样本上训练,在9个火星任务中超越现有基线表现
- 特别提升分割任务性能,适合火星遥感与行星科学研究者
我们提出MOMO,首个面向火星遥感的多传感器基础模型。MOMO采用模型合并方法,整合来自三大关键火星传感器(HiRISE、CTX、THEMIS)的独立学习表征,覆盖0.25米/像素至100米/像素的分辨率范围。核心是提出的等效验证损失(EVL)策略,基于验证损失相似性对齐不同传感器的检查点,再通过任务算术进行融合,确保在兼容收敛阶段合并,提升稳定性与泛化能力。MOMO在约1200万张精选火星轨道数据样本上训练,并在Mars-Bench的9项下游任务上评估。相比ImageNet预训练、地球观测基础模型、传感器特异性预训练及全监督基线,MOMO整体表现更优,尤其在分割任务中展现出持续且显著的性能提升。结果表明,通过最优检查点选择策略进行模型合并,是构建多分辨率数据基础模型的有效途径。模型权重、预训练代码、数据及评估代码已公开于:https://github.com/kerner-lab/MOMO。
原文摘要 · Abstract (English)
We introduce MOMO, the first multi-sensor foundation model for Mars remote sensing. MOMO uses model merge to integrate representations learned independently from three key Martian sensors (HiRISE, CTX, and THEMIS), spanning resolutions from 0.25 m/pixel to 100 m/pixel. Central to our method is our novel Equal Validation Loss (EVL) strategy, which aligns checkpoints across sensors based on validation loss similarity before fusion via task arithmetic. This ensures models are merged at compatible convergence stages, leading to improved stability and generalization. We train MOMO on a large-scale, high-quality corpus of $\sim 12$ million samples curated from Mars orbital data and evaluate it on 9 downstream tasks from Mars-Bench. MOMO achieves better overall performance compared to ImageNet pre-trained, earth observation foundation model, sensor-specific pre-training, and fully-supervised baselines. Particularly on segmentation tasks, MOMO shows consistent and significant performance improvement. Our results demonstrate that model merging through an optimal checkpoint selection strategy provides an effective approach for building foundation models for multi-resolution data. The model weights, pretraining code, pretraining data, and evaluation code are available at: https://github.com/kerner-lab/MOMO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。