用解释引导剪枝,让遥感图像分类的联邦学习通信量更少
Communication-Efficient Federated Learning Based on Explanation-Guided Pruning for Remote Sensing Image Classification
- 基于层间相关性传播的解释,筛选重要参数
- 减少90%以上模型更新量,且提升全局模型泛化能力
- 适合带宽受限的遥感数据联邦学习场景
联邦学习(FL)是一种去中心化的机器学习范式,多个客户端通过仅交换模型更新而非本地数据来协同训练全局模型。由于客户端与中央服务器间需传输大量模型更新,大多数FL系统存在较高的传输成本(即通信开销)。这一问题在遥感(RS)应用中尤为突出,尤其是在通信带宽受限的情况下处理大规模遥感数据时。为此,本文提出一种基于解释引导剪枝的通信高效联邦学习方法,用于遥感图像分类任务。该方法利用层间相关性传播(LRP)生成的解释,识别最具信息量的模型参数,剔除冗余参数,从而减少需传输的模型更新量。在BigEarthNet-S2数据集上的实验表明,该策略显著降低了模型更新传输次数,同时提升了全局模型的泛化能力。代码已公开于https://git.tu-berlin.de/rsim/FL-LRP。
原文摘要 · Abstract (English)
Federated learning (FL) is a decentralized machine learning paradigm in which multiple clients collaboratively train a global model by exchanging only model updates with the central server without sharing the local data of the clients. Due to the large volume of model updates required to be transmitted between clients and the central server, most FL systems are associated with high transfer costs (i.e., communication overhead). This issue is more critical for operational applications in remote sensing (RS), especially when large-scale RS data is processed and analyzed through FL systems with restricted communication bandwidth. To address this issue, we introduce an explanation-guided pruning strategy for communication-efficient FL in the context of RS image classification. Our pruning strategy is defined based on the layer-wise relevance propagation (LRP) driven explanations to: 1) efficiently and effectively identify the most relevant and informative model parameters (to be exchanged between clients and the central server); and 2) eliminate the non-informative ones to minimize the volume of model updates. The experimental results on the BigEarthNet-S2 dataset demonstrate that our strategy effectively reduces the number of shared model updates, while increasing the generalization ability of the global model. The code of this work is publicly available at https://git.tu-berlin.de/rsim/FL-LRP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。