用解释引导剪枝,让遥感联邦学习更省通信量。
FedX: Explanation-Guided Pruning for Communication-Efficient Federated Learning in Remote Sensing
- 根据模型组件重要性,由服务器剪掉不关键部分
- 在两个遥感数据集上参数量减少超70%且泛化更强
- 适合隐私敏感的遥感图像分类场景
联邦学习(FL)使分散数据源上的深度神经网络协同训练成为可能,各客户端本地存储数据并仅向中心服务器上传模型更新,适用于受法律与隐私限制而无法集中数据的遥感(RS)图像分类任务。然而,频繁传输大型模型更新带来的通信开销是主要挑战。为此,本文提出一种新策略FedX,通过解释引导剪枝减少通信负担:利用基于反向传播的解释方法评估模型组件的任务相关重要性,在中心服务器处剪除最不重要的部分,生成稀疏全局模型后下发至客户端,显著降低通信量。在BigEarthNet-S2多标签场景分类和EuroSAT单标签场景分类任务上验证表明,相比未剪枝模型及现有先进剪枝方法,FedX能大幅减少共享参数数量,并提升全局模型泛化能力。代码将公开于https://git.tu-berlin.de/rsim/FedX。
原文摘要 · Abstract (English)
Federated learning (FL) enables the collaborative training of deep neural networks across decentralized data archives (i.e., clients), where each client stores data locally and only shares model updates with a central server. This makes FL a suitable learning paradigm for remote sensing (RS) image classification tasks, where data centralization may be restricted due to legal and privacy constraints. However, a key challenge in applying FL to RS tasks is the communication overhead caused by the frequent exchange of large model updates between clients and the central server. To address this issue, in this paper we propose a novel strategy (denoted as FedX) that uses explanation-guided pruning to reduce communication overhead by minimizing the size of the transmitted models without compromising performance. FedX leverages backpropagation-based explanation methods to estimate the task-specific importance of model components and prunes the least relevant ones at the central server. The resulting sparse global model is then sent to clients, substantially reducing communication overhead. We evaluate FedX on multi-label scene classification using the BigEarthNet-S2 dataset and single-label scene classification using the EuroSAT dataset. Experimental results show the success of FedX in significantly reducing the number of shared model parameters while enhancing the generalization capability of the global model, compared to both unpruned model and state-of-the-art pruning methods. The code of FedX will be available at https://git.tu-berlin.de/rsim/FedX.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。