让不同算力的设备都能参与脉冲神经网络联邦学习,提升能效。
SFedHIFI: Fire Rate-Based Heterogeneous Information Fusion for Spiking Federated Learning

- 按设备能力动态调整脉冲神经网络复杂度,实现异构适配。
- 跨模型宽度融合信息,有效利用各设备本地知识。
- 比传统方法节能显著,适合资源受限设备部署。
脉冲联邦学习(SFL)因其脉冲神经网络(SNNs)的高能效备受关注。然而,现有SFL方法要求模型同质且假定所有客户端具备充足计算资源,导致部分资源受限设备被排除在外。为应对真实场景中的普遍系统异构性,实现可根据本地资源自适应部署不同规模模型的异构SFL系统至关重要。为此,本文提出SFedHIFI:一种基于发放率的异构信息融合脉冲联邦学习框架。具体地,SFedHIFI采用通道级矩阵分解,在异构资源客户端上部署可变复杂度的SNN模型。在此基础上,提出的异构信息融合模块实现了不同宽度模型间的跨尺度聚合,从而提升多样本地知识的利用率。在三个公开基准上的大量实验表明,SFedHIFI能有效实现异构SFL,始终优于三种基线方法。相比基于ANN的联邦学习,其在仅小幅损失准确率的情况下实现显著能效提升。
原文摘要 · Abstract (English)
Spiking Federated Learning (SFL) has been widely studied with the energy efficiency of Spiking Neural Networks (SNNs). However, existing SFL methods require model homogeneity and assume all clients have sufficient computational resources, resulting in the exclusion of some resource-constrained clients. To address the prevalent system heterogeneity in real-world scenarios, enabling heterogeneous SFL systems that allow clients to adaptively deploy models of different scales based on their local resources is crucial. To this end, we introduce SFedHIFI, a novel Spiking Federated Learning framework with Fire Rate-Based Heterogeneous Information Fusion. Specifically, SFedHIFI employs channel-wise matrix decomposition to deploy SNN models of adaptive complexity on clients with heterogeneous resources. Building on this, the proposed heterogeneous information fusion module enables cross-scale aggregation among models of different widths, thereby enhancing the utilization of diverse local knowledge. Extensive experiments on three public benchmarks demonstrate that SFedHIFI can effectively enable heterogeneous SFL, consistently outperforming all three baseline methods. Compared with ANN-based FL, it achieves significant energy savings with only a marginal trade-off in accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。