arXiv:2602.19863cs.CV2026-02中稿 · CVPR被引 4

用双教师对比蒸馏,让多光谱遥感模型同时学好光学与多光谱数据。

Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observation

  • 设计双教师框架,融合多光谱与光学视觉模型知识进行对比蒸馏。
  • 在语义分割、变化检测等任务上平均提升3.64%、1.2%、1.31%。
  • 适合需要跨模态遥感数据统一建模的研究者和应用开发者。

基础模型正在重塑地球观测(EO),但传感器与模态的多样性使得单一通用模型不现实。未来将存在多个专用的地球观测基础模型(EOFMs),因此跨模态高效知识迁移至关重要。现有多数EO预训练依赖掩码图像建模,强调局部重建,对全局语义结构控制有限。为此,我们提出一种用于多光谱影像的双教师对比蒸馏框架,使学生模型的预训练目标与现代光学视觉基础模型(VFMs)的对比自蒸馏范式对齐。该方法结合多光谱教师与光学VFM教师,实现一致的跨模态表示学习。在多样化的光学与多光谱基准上实验表明,我们的模型在不降低纯光学输入性能的前提下,适应多光谱数据,在语义分割、变化检测和分类任务上分别取得3.64、1.2和1.31个百分点的平均提升,证明对比蒸馏是一种可扩展且高效的异构地球观测数据表示学习方法。

原文摘要 · Abstract (English)

Foundation models are transforming Earth Observation (EO), yet the diversity of EO sensors and modalities makes a single universal model unrealistic. Multiple specialized EO foundation models (EOFMs) will likely coexist, making efficient knowledge transfer across modalities essential. Most existing EO pretraining relies on masked image modeling, which emphasizes local reconstruction but provides limited control over global semantic structure. To address this, we propose a dual-teacher contrastive distillation framework for multispectral imagery that aligns the student's pretraining objective with the contrastive self-distillation paradigm of modern optical vision foundation models (VFMs). Our approach combines a multispectral teacher with an optical VFM teacher, enabling coherent cross-modal representation learning. Experiments across diverse optical and multispectral benchmarks show that our model adapts to multispectral data without compromising performance on optical-only inputs, achieving state-of-the-art results in both settings, with an average improvement of 3.64 percentage points in semantic segmentation, 1.2 in change detection, and 1.31 in classification tasks. This demonstrates that contrastive distillation provides a principled and efficient approach to scalable representation learning across heterogeneous EO data sources. Project page: \textcolor{magenta}{https://wolfilip.github.io/DEO/}.

遥感对比学习知识蒸馏多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。