arXiv:2605.28174cs.CVcs.AI2026-05被引 1

FLORO用小而多样数据训练,跨传感器和尺度的生态遥感模型表现强。

FLORO: A Multimodal Geospatial Foundation Model for Ecological Remote Sensing Across Sensors and Scales

论文配图:FLORO: A Multimodal Geospatial Foundation Model for Ecological Remote Sensing Across Sensors and Scales
图 1 · 摘自论文原文
  • 用掩码自编码在多源遥感数据上预训练,支持不同传感器组合输入。
  • 在六个基准上平均分割性能第二,优于多数大模型,且在回归任务中稳定。
  • 适合处理多平台、多分辨率生态数据,尤其适用于小样本场景。

基础模型为可迁移的遥感表征提供了前景,但现有方法多依赖大规模预训练数据集与固定传感器配置,难以适配生态与环境应用中多变的观测条件。我们提出FLORO,一种面向跨传感器与尺度的生态遥感的多模态地理空间基础模型。其在包含哨兵-1、哨兵-2、天空卫星影像、高程及无人机数据的异构数据集上,通过掩码自编码进行预训练。为应对传感器差异,模型引入可用性感知输入,动态标识每样本中存在哪些波段与辅助模态,实现跨异构配置的统一输入空间。在PANGAEA基准上,采用冻结编码器协议评估其在场景分类、分割与回归任务中的迁移能力。尽管预训练数据量小于多数竞争模型,FLORO仍实现强且稳定的跨域迁移,在光学、光学-SAR、光学-高程等基准上覆盖中分辨率卫星、航空与超高分辨率无人机影像。其平均分割性能位列第二,仅落后于一个在超过两数量级更多图像上预训练的模型;在场景分类中保持竞争力,回归任务表现稳健,定性结果表明其在洪水、城市、生物量与树冠高度预测中更优地保留空间结构。在EuroSAT-MS的控制实验中,地理位置编码相较绝对位置编码进一步提升分类性能。

原文摘要 · Abstract (English)

Foundation models offer a promising route to transferable remote sensing representations, but many current approaches depend on very large pretraining datasets and fixed sensor configurations, limiting their suitability for ecological and environmental applications, where observations often vary across platforms, spatial and spectral resolutions, and available modalities. We introduce FLORO, a multimodal geospatial foundation model designed to learn transferable representations from a small but highly diverse remote sensing corpus. FLORO is pretrained using masked autoencoding on a heterogeneous combination of Sentinel-1, Sentinel-2, SkySAT imagery, elevation, and UAV-derived data. To accommodate sensor variability, FLORO incorporates availability-aware inputs that indicate which spectral bands and auxiliary modalities are present in each sample, enabling a unified input space across heterogeneous sensor configurations. We evaluated FLORO on the PANGAEA benchmark under a frozen-encoder protocol across scene classification, segmentation, and regression tasks. Despite being pretrained on a smaller corpus than competing foundation models, FLORO achieved strong and stable transfer across optical, optical-SAR, and optical-elevation benchmarks spanning medium-resolution satellite, airborne, and ultra-high-resolution UAV imagery. FLORO obtained the second-best average segmentation performance across six PANGAEA benchmarks, trailing only a recently introduced foundation model pretrained on over two orders of magnitude more images, remained competitive on scene classification, and was robust in regression tasks, while qualitative results showed improved preservation of spatial structure in flood, urban, biomass, and canopy-height prediction settings. In a separate controlled experiment on EuroSAT-MS, geo-positional encoding further improved classification relative to absolute positional encoding.

遥感多模态基础模型生态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。