解决异步联邦学习中罕见标签样本贡献被忽略的问题
FedRAW: Preserving Rare-Label Influence in Asynchronous Federated Learning

- 通过去重与标签感知加权,增强罕见标签客户端的影响力
- 在多个数据集上提升罕见标签准确率,全局准确率基本不变
- 仅需服务器端修改,无需改动客户端训练或通信
异步联邦学习通过服务器端缓冲客户端更新实现高效扩展,但可能导致罕见标签样本影响被弱化。我们发现‘隐性稀有性失效’:尽管全局准确率看似正常,持有罕见标签的客户端仍贡献不足。这源于两个耦合因素:罕见标签客户端因速度慢或不可用而提交更新频率低(参与偏差);其更新进入缓冲区后,标准聚合未给予补偿权重(聚合偏差)。我们提出FedRAW,一种全服务器端聚合方法,在不改变本地训练、客户端目标或通信协议的前提下,通过客户端更新去重和罕见标签感知加权,有效保留罕见标签影响。理论分析揭示了参与与聚合偏差的根源,并证明FedRAW在保持收敛性的前提下,显著提升罕见标签客户端的影响。在EMNIST Balanced、CIFAR-10、HAM10000和ISIC-2019数据集上,该方法提升了罕见标签准确率,同时维持相近全局准确率,且服务器端计算开销极小。
原文摘要 · Abstract (English)
Asynchronous federated learning improves scalability by updating the global model from a server-side buffer of client updates as they arrive, rather than waiting for all selected clients to finish. While efficient, this arrival-driven aggregation can silently distort representation learning under heterogeneous participation. We identify silent rarity failure, a hidden failure mode in which clients holding rare labels contribute too weakly to the global model even though its overall accuracy appears largely unaffected. This failure arises from two coupled effects: rare-label clients may submit updates less frequently when they are slower or less available, creating participation bias; and once their updates enter the buffer, standard asynchronous aggregation assigns them no compensating influence, creating aggregation bias. We propose FedRAW, a fully server-side aggregation method that preserves rare-label influence without changing local training, client objectives, or communication protocols. FedRAW combines client-level update deduplication, which prevents frequently arriving clients from repeatedly dominating the update buffer, with rare-label-aware weighting, which increases the influence of clients carrying low-coverage labels. We formalize silent rarity failure through participation and aggregation bias, and show that FedRAW increases rare-label client influence over uniform aggregation while preserving convergence. Across EMNIST Balanced, CIFAR-10, HAM10000, and ISIC-2019, FedRAW improves rarelabel accuracy while preserving comparable global accuracy and adding negligible server-side computation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。