arXiv:2503.10845cs.LG2025-03CVPR被引 37

Panopticon让遥感模型能通用任意卫星传感器,无需重新训练。

Panopticon: Advancing Any-Sensor Foundation Models for Earth Observation

  • 用多传感器同位置图像做自然数据增强,提升泛化能力。
  • 在GEO-Bench上超越现有模型,尤其在哨兵1/2数据上表现最佳。
  • 适合需要跨平台兼容的遥感应用,如灾情监测与环境评估。

地球观测(EO)数据来自多种感知平台,具有不同的光谱波段、空间分辨率和传感模态。以往研究通常限定输入为固定传感器,而近期出现可处理任意传感器的通用基础模型。本文提出基于DINOv2框架的Panopticon模型,通过三方面改进:(1)将同一地理坐标下不同传感器图像视为自然增强;(2)对通道进行子采样以丰富光谱输入;(3)引入通道间交叉注意力作为灵活的图像块嵌入机制。该模型能有效编码光学与合成孔径雷达传感器的波长与模式信息,实现对任意通道组合的处理。在广泛评估中,Panopticon在GEO-Bench上取得领先性能,尤其在广泛使用的哨兵1号与哨兵2号传感器上表现突出,优于其他任意传感器模型及领域适配的固定传感器模型,在独特传感器配置下亦具优势。该模型可立即推广至现有及未来卫星平台,推动传感器无关的地球观测发展。

原文摘要 · Abstract (English)

Earth observation (EO) data features diverse sensing platforms with varying spectral bands, spatial resolutions, and sensing modalities. While most prior work has constrained inputs to fixed sensors, a new class of any-sensor foundation models able to process arbitrary sensors has recently emerged. Contributing to this line of work, we propose Panopticon, an any-sensor foundation model built on the DINOv2 framework. We extend DINOv2 by (1) treating images of the same geolocation across sensors as natural augmentations, (2) subsampling channels to diversify spectral input, and (3) adding a cross attention over channels as a flexible patch embedding mechanism. By encoding the wavelength and modes of optical and synthetic aperture radar sensors, respectively, Panopticon can effectively process any combination of arbitrary channels. In extensive evaluations, we achieve state-of-the-art performance on GEO-Bench, especially on the widely-used Sentinel-1 and Sentinel-2 sensors, while out-competing other any-sensor models, as well as domain adapted fixed-sensor models on unique sensor configurations. Panopticon enables immediate generalization to both existing and future satellite platforms, advancing sensor-agnostic EO.

遥感基础模型多源融合卫星

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。