首个系统综述遥感基础模型,揭示其在地球观测中的潜力与挑战
Foundation Models for Remote Sensing and Earth Observation: A Survey
- 梳理遥感基础模型的技术框架与核心概念
- 涵盖视觉、图文、语言等多类模型,对比公开数据集表现
- 适合遥感与AI交叉研究者,助你快速掌握前沿方向
遥感是观测、监测和解析地球的关键技术,广泛应用于地质科学、经济与人道领域。尽管人工智能(尤其是深度学习)在遥感领域取得显著进展,但复杂地球环境、多源传感器、独特特征模式、不同空间/光谱分辨率及时间动态等挑战依然存在。近年来,大型基础模型在图像、视频等自然数据上展现出卓越的泛化能力与零样本迁移性能,但在多类非光学遥感数据上表现下降甚至失效。这促使研究者探索遥感基础模型(RSFMs),以应对地表、大气、海洋等地球观测任务的复杂需求。本综述系统梳理了这一新兴领域:从动机背景出发,介绍基础概念,分类评述现有研究(包括数据集与技术贡献),涵盖视觉基础模型(VFMs)、视觉-语言模型(VLMs)、大语言模型(LLMs)等。同时,在公开数据集上进行基准测试,讨论现存挑战,并提出未来研究方向。相关项目已开源:https://github.com/xiaoaoran/awesome-RSFMs。
原文摘要 · Abstract (English)
Remote Sensing (RS) is a crucial technology for observing, monitoring, and interpreting our planet, with broad applications across geoscience, economics, humanitarian fields, etc. While artificial intelligence (AI), particularly deep learning, has achieved significant advances in RS, unique challenges persist in developing more intelligent RS systems, including the complexity of Earth's environments, diverse sensor modalities, distinctive feature patterns, varying spatial and spectral resolutions, and temporal dynamics. Meanwhile, recent breakthroughs in large Foundation Models (FMs) have expanded AI's potential across many domains due to their exceptional generalizability and zero-shot transfer capabilities. However, their success has largely been confined to natural data like images and video, with degraded performance and even failures for RS data of various non-optical modalities. This has inspired growing interest in developing Remote Sensing Foundation Models (RSFMs) to address the complex demands of Earth Observation (EO) tasks, spanning the surface, atmosphere, and oceans. This survey systematically reviews the emerging field of RSFMs. It begins with an outline of their motivation and background, followed by an introduction of their foundational concepts. It then categorizes and reviews existing RSFM studies including their datasets and technical contributions across Visual Foundation Models (VFMs), Visual-Language Models (VLMs), Large Language Models (LLMs), and beyond. In addition, we benchmark these models against publicly available datasets, discuss existing challenges, and propose future research directions in this rapidly evolving field. A project associated with this survey has been built at https://github.com/xiaoaoran/awesome-RSFMs .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。