arXiv:2603.07774cs.CV2026-03

通过几何知识引导的双知识蒸馏,提升遥感卫星图像联邦学习效果。

Geometric Knowledge-Assisted Federated Dual Knowledge Distillation Approach Towards Remote Sensing Satellite Imagery

  • 本地用无标签数据训练学生网络,生成教师编码器并构建教师网络。
  • 聚合局部协方差矩阵生成全局几何知识,用于增强本地嵌入表示。
  • 在EuroSAT上相较SOTA提升68.89%,适合遥感图像联邦学习场景。

联邦学习(FL)已成为分析遥感卫星影像(RSSI)的有前景方案。然而,多颗卫星采集的图像具有大规模和固有的数据异构性,各卫星本地数据分布与全局分布存在差异,严重阻碍了有效模型训练。为此,我们提出一种几何知识引导的联邦双知识蒸馏框架(GK-FedDKD),用于RSSI分析。每个本地客户端首先利用未标注增强数据训练的多个学生编码器,蒸馏出教师编码器(TE)。TE与共享分类器连接形成教师网络(TN),监督新学生网络(SN)的训练。利用TN的中间特征计算局部协方差矩阵,并在服务器聚合生成全局几何知识(GGK)。该GGK用于本地嵌入增强,进一步指导SN训练。我们还设计了新型损失函数和多原型生成管道以稳定训练过程。在多个数据集上的评估表明,所提GK-FedDKD优于现有最先进方法,例如采用Swin-T骨干的方案在EuroSAT上平均提升68.89%。

原文摘要 · Abstract (English)

Federated learning (FL) has recently become a promising solution for analyzing remote sensing satellite imagery (RSSI). However, the large scale and inherent data heterogeneity of images collected from multiple satellites, where the local data distribution of each satellite differs from the global one, present significant challenges to effective model training. To address this issue, we propose a Geometric Knowledge-Guided Federated Dual Knowledge Distillation (GK-FedDKD) framework for RSSI analysis. In our approach, each local client first distills a teacher encoder (TE) from multiple student encoders (SEs) trained with unlabeled augmented data. The TE is then connected with a shared classifier to form a teacher network (TN) that supervises the training of a new student network (SN). The intermediate representations of the TN are used to compute local covariance matrices, which are aggregated at the server to generate global geometric knowledge (GGK). This GGK is subsequently employed for local embedding augmentation to further guide SN training. We also design a novel loss function and a multi-prototype generation pipeline to stabilize the training process. Evaluation over multiple datasets showcases that the proposed GK-FedDKD approach is superior to the considered state-of-the-art baselines, e.g., the proposed approach with the Swin-T backbone surpasses previous SOTA approaches by an average 68.89% on the EuroSAT dataset.

遥感图像联邦学习知识蒸馏几何知识

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。