解决联邦学习中知识融合偏差问题,提升模型泛化与个性化平衡。
Choice Outweighs Effort: Facilitating Complementary Knowledge Fusion in Federated Learning via Re-calibration and Merit-discrimination
- 动态构建全局原型,综合样本量、参数和预测调整聚合权重。
- 客户端通过能力区分训练和成本感知传输,实现知识互补融合。
- 在五个数据集上超越主流方法,适用于自动驾驶等实际场景。
联邦学习中的跨客户端数据异质性导致偏差,阻碍无偏共识凝聚与泛化与个性化知识的互补融合。现有方法虽通过模型解耦和表示中心损失缓解异质性,但常依赖静态受限指标评估本地知识,并过度刚性对齐全局特征,造成共识扭曲与模型适应性下降。为此,我们提出FedMate,实现双向优化:服务器端构建动态全局原型,聚合权重由样本量、当前参数与未来预测的综合信息校准;随后基于该原型微调类别分类器以保持全局一致性。客户端引入互补分类融合机制,实现基于能力的区分训练,并采用成本感知特征传输,在性能与通信效率间取得平衡。五个不同复杂度数据集上的实验表明,FedMate在协调泛化与自适应方面优于当前最优方法。此外,自动驾驶数据集上的语义分割实验验证了该方法的实际可扩展性。
原文摘要 · Abstract (English)
Cross-client data heterogeneity in federated learning induces biases that impede unbiased consensus condensation and the complementary fusion of generalization- and personalization-oriented knowledge. While existing approaches mitigate heterogeneity through model decoupling and representation center loss, they often rely on static and restricted metrics to evaluate local knowledge and adopt global alignment too rigidly, leading to consensus distortion and diminished model adaptability. To address these limitations, we propose FedMate, a method that implements bilateral optimization: On the server side, we construct a dynamic global prototype, with aggregation weights calibrated by holistic integration of sample size, current parameters, and future prediction; a category-wise classifier is then fine-tuned using this prototype to preserve global consistency. On the client side, we introduce complementary classification fusion to enable merit-based discrimination training and incorporate cost-aware feature transmission to balance model performance and communication efficiency. Experiments on five datasets of varying complexity demonstrate that FedMate outperforms state-of-the-art methods in harmonizing generalization and adaptation. Additionally, semantic segmentation experiments on autonomous driving datasets validate the method's real-world scalability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。