arXiv:2608.07007cs.AIcs.DC2026-08被引 3

用验证损失动态加权,提升非独立同分布场景下的联邦学习性能

FedLBW: A Loss-Based Weighting Strategy for Federated Learning on Non-IID Data in Wireless Networks

论文配图:FedLBW: A Loss-Based Weighting Strategy for Federated Learning on Non-IID Data in Wireless Networks
图 1 · 摘自论文原文
  • 根据客户端验证损失反比分配权重,避免大样本偏差
  • 在极端非独立同分布下,准确率最高提升7.6%
  • 对客户端掉线有强鲁棒性,适合无线网络场景

联邦学习(FL)可在保护隐私的前提下实现分布式协同机器学习,但在无线网络中,由于数据非独立同分布(non-IID)及频繁客户端掉线,模型高效收敛仍具挑战。传统算法如FedAvg仅依据数据集大小加权,易偏向大样本客户端,对非IID数据、异常值和掉线敏感。为此,本文提出基于损失的加权联邦学习(FedLBW),在服务器上利用小规模代理数据计算各客户端的验证损失,并按其倒数分配更新权重,使低损失模型在聚合中占更大比重,从而优先采纳更可靠的更新。在FashionMNIST(CNN)、CIFAR-10(ResNet-18)和CIFAR-100(ResNet-34)等多数据集上的实验表明,与FedAvg、FedAvgM、FedProx、FedNova、FedLAW和FedDkw等基线方法相比,FedLBW显著提升了准确率并加速收敛,在极端非IID情况下,CIFAR-10上的准确率最高提升达7.6%。同时,面对不断上升的掉线概率,FedLBW始终维持显著更高的准确率,展现出优异的鲁棒性。该结果证实,FedLBW是无线网络环境下联邦学习的有效且稳健解决方案,大幅提升了模型精度、收敛速度以及对非独立同分布数据和客户端掉线的适应能力。

原文摘要 · Abstract (English)

Federated Learning (FL) enables collaborative machine learning (ML) across distributed clients while preserving privacy. However, efficient model convergence in FL remains challenging, especially in wireless networks where non-independent and identically distributed (non-IID) data and frequent client dropouts are common. Traditional FL algorithms, such as FedAvg, rely solely on dataset size to weight client updates. This introduces biases towards clients with larger datasets and makes the process sensitive to non-IID data, outliers, and client dropouts. To address these challenges, we propose Federated Learning with Loss-Based Weighting (FedLBW), a novel aggregation method that assigns each client's update a weight proportional to the inverse of its validation loss, computed using a small proxy dataset on the server, rather than its dataset size. This ensures that lower-loss models exert greater influence during aggregation, prioritizing the most reliable updates and boosting overall performance. Through extensive experiments across multiple datasets, including FashionMNIST (CNN), CIFAR-10 (ResNet-18), and CIFAR-100 (ResNet-34), we demonstrate that FedLBW achieves higher accuracy and faster convergence compared to baseline algorithms such as FedAvg, FedAvgM, FedProx, FedNova, FedLAW and FedDkw, with notable improvements of up to 7.6 % higher accuracy on CIFAR-10 in extreme non-IID cases. Moreover, FedLBW showcases exceptional resilience to increasing dropout probabilities, consistently maintaining significantly higher accuracy even in challenging conditions. These results establish FedLBW as an effective and resilient solution for FL in wireless network environments, offering marked improvements in model accuracy, convergence speed, and robustness to non-IID data and client dropouts.

联邦学习非独立同分布无线网络加权聚合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。