arXiv:2503.23844cs.CV2025-03被引 46

FlexiMo让遥感模型自适应任意分辨率,提升多源影像分析能力。

FlexiMo: A Flexible Remote Sensing Foundation Model

  • 通过无参数对齐嵌入机制动态调整图像块特征,适配不同分辨率。
  • 在多个任务上表现优异,如地物分类、建筑分割和云检测,跨尺度泛化强。
  • 适合需要处理多源异构遥感数据的研究与应用,如智慧城市、环境监测。

多源卫星影像的快速扩展推动了地球观测领域的创新,为遥感基础模型提供了前所未有的机遇。然而,现有模型通常受限于固定的空间分辨率和图像块大小,难以充分挖掘遥感影像固有的异质空间特性。为此,我们提出 FlexiMo,一种可灵活适配任意空间分辨率的遥感基础模型。其核心是空间分辨率感知模块,采用无参数对齐嵌入机制,根据输入图像的分辨率和尺寸动态校准图像块嵌入,既保留关键标记特征,又确保多尺度特征保真性,且无需修改网络架构即可高效提取特征。此外,引入轻量级通道适应模块,利用传感器先验光谱信息,使模型可处理不同通道数的图像,同时保持数据的物理一致性。在多种多模态、多分辨率、多尺度数据集上的大量实验表明,FlexiMo显著提升了模型的泛化能力和鲁棒性,在场景分类、土地覆盖分类、城市建筑分割和云检测等下游任务中均取得优异表现。通过实现参数高效且物理一致的适应,FlexiMo为真实遥感应用中的更灵活、更高效的模型奠定了基础。

原文摘要 · Abstract (English)

The rapid expansion of multi-source satellite imagery drives innovation in Earth observation, opening unprecedented opportunities for Remote Sensing Foundation Models to harness diverse data. However, many existing models remain constrained by fixed spatial resolutions and patch sizes, limiting their ability to fully exploit the heterogeneous spatial characteristics inherent in satellite imagery. To address these challenges, we propose FlexiMo, a flexible remote sensing foundation model that endows the pre-trained model with the flexibility to adapt to arbitrary spatial resolutions. Central to FlexiMo is a spatial resolution-aware module that employs a parameter-free alignment embedding mechanism to dynamically recalibrate patch embeddings based on the input image's resolution and dimensions. This design not only preserves critical token characteristics and ensures multi-scale feature fidelity but also enables efficient feature extraction without requiring modifications to the underlying network architecture. In addition, FlexiMo incorporates a lightweight channel adaptation module that leverages prior spectral information from sensors. This mechanism allows the model to process images with varying numbers of channels while maintaining the data's intrinsic physical properties. Extensive experiments on diverse multimodal, multi-resolution, and multi-scale datasets demonstrate that FlexiMo significantly enhances model generalization and robustness. In particular, our method achieves outstanding performance across a range of downstream tasks, including scene classification, land cover classification, urban building segmentation, and cloud detection. By enabling parameter-efficient and physically consistent adaptation, FlexiMo paves the way for more adaptable and effective foundation models in real-world remote sensing applications.

遥感基础模型多尺度自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。