从单模到多模,解析遥感领域基础模型的演进路径
Foundation Models in Remote Sensing: Evolving from Unimodality to Multimodality
- 梳理遥感基础模型从单模态到多模态的发展脉络
- 系统分类现有遥感基础模型并提供训练应用指南
- 适合初学者快速入门遥感大模型研究
遥感技术对深化地球认知愈发重要。随着遥感数据量和多样性的指数级增长,亟需先进的数据建模与理解能力来有效管理与解析这些海量数据。基础模型为遥感领域带来巨大潜力与新机遇。本文开展了一项全面的技术综述,首次从单模态向多模态演进的角度审视遥感中的基础模型。通过回答三个核心问题:遥感中的基础模型是什么?为何需要它们?如何引导新手全面掌握其应用?本文首先阐述背景与动机,强调基础模型在遥感中的关键作用;随后系统梳理现有模型,将其分为单模态与多模态两类;并提供教程式指导,帮助研究人员(尤其是初学者)掌握遥感基础模型的训练方法与实际应用。本综述旨在帮助遥感研究者更深入、高效地理解基础模型,快速启动跨任务应用。
原文摘要 · Abstract (English)
Remote sensing (RS) techniques are increasingly crucial for deepening our understanding of the planet. As the volume and diversity of RS data continue to grow exponentially, there is an urgent need for advanced data modeling and understanding capabilities to manage and interpret these vast datasets effectively. Foundation models present significant new growth opportunities and immense potential to revolutionize the RS field. In this paper, we conduct a comprehensive technical survey on foundation models in RS, offering a brand-new perspective by exploring their evolution from unimodality to multimodality. We hope this work serves as a valuable entry point for researchers interested in both foundation models and RS and helps them launch new projects or explore new research topics in this rapidly evolving area. This survey addresses the following three key questions: What are foundation models in RS? Why are foundation models needed in RS? How can we effectively guide junior researchers in gaining a comprehensive and practical understanding of foundation models in RS applications? More specifically, we begin by outlining the background and motivation, emphasizing the importance of foundation models in RS. We then review existing foundation models in RS, systematically categorizing them into unimodal and multimodal approaches. Additionally, we provide a tutorial-like section to guide researchers, especially beginners, on how to train foundation models in RS and apply them to real-world tasks. The survey aims to equip researchers in RS with a deeper and more efficient understanding of foundation models, enabling them to get started easily and effectively apply these models across various RS applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。