arXiv:2504.17177cs.CVcs.LG2025-04中稿 · as of January 12th…被引 7

梳理遥感领域基础模型发展脉络,揭示多源数据融合潜力。

A Genealogy of Foundation Models in Remote Sensing

  • 从单传感器模型出发,分析遥感基础模型的演进路径
  • 指出现有方法在多源数据利用上仍不充分,存在计算资源依赖
  • 适合关注遥感与多模态融合的研究者参考

基础模型在遥感表征学习中日益受到关注。尽管许多模型借鉴了计算机视觉的成功经验并仅作少量领域适配,但其在遥感领域的开发与应用仍处于初期阶段,不同技术路线竞争激烈。本文系统考察这些方法及其在计算机视觉中的起源,旨在阐明潜在优势与风险,并提出未来改进方向。重点讨论所学表征的质量,以及降低对大规模算力依赖的方法。首先回顾单传感器遥感基础模型以建立概念框架,随后聚焦地球观测中多传感器特性在基础模型中的整合。特别探讨现有方法在训练中利用多源数据的程度,与多模态基础模型的关系。最后,提出进一步挖掘海量未标注、季节性、多传感器遥感数据的机遇。

原文摘要 · Abstract (English)

Foundation models have garnered increasing attention for representation learning in remote sensing. Many such foundation models adopt approaches that have demonstrated success in computer vision with minimal domain-specific modification. However, the development and application of foundation models in this field are still burgeoning, as there are a variety of competing approaches for how to most effectively leverage remotely sensed data. This paper examines these approaches, along with their roots in the computer vision field. This is done to characterize potential advantages and pitfalls, while outlining future directions to further improve remote sensing-specific foundation models. We discuss the quality of the learned representations and methods to alleviate the need for massive compute resources. We first examine single-sensor remote foundation models to introduce concepts and provide context, and then place emphasis on incorporating the multi-sensor aspect of Earth observations into foundation models. In particular, we explore the extent to which existing approaches leverage multiple sensors in training foundation models in relation to multi-modal foundation models. Finally, we identify opportunities for further harnessing the vast amounts of unlabeled, seasonal, and multi-sensor remote sensing observations.

遥感基础模型多源数据表征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。