arXiv:2603.25289cs.DCcs.AI2026-03

研究联邦学习中参与者失效对模型质量的影响,揭示数据偏斜的严重干扰作用。

Revealing the influence of participant failures on model quality in cross-silo Federated Learning

  • 通过大量实验分析参与者缺失对模型性能的影响
  • 发现数据偏斜导致评估结果过度乐观,甚至改变其他因素影响
  • 适合关注联邦学习可靠性与实际部署的工程师和研究者

联邦学习(FL)是一种在保护隐私的前提下协同训练机器学习模型的范式,其核心要求是可靠性,因为可靠性不足会破坏学习结果的有效性、稳定性和可复现性。由于FL本质上是分布式系统,易受崩溃故障、网络分区等异常情况影响。然而,这些故障对FL结果的影响尚未得到系统研究。本文通过在图像、表格和时间序列数据上开展广泛实验,分析参与者缺失对模型性能的影响,考虑了数据偏斜、不同可用性模式和模型架构等关键因素。此外,还考察了特定场景下全局模型对缺失参与者的可用性。实验揭示了多种影响因素的详细作用机制,特别是数据偏斜具有显著影响,常导致模型评估过于乐观,甚至改变其他因素的作用方向。

原文摘要 · Abstract (English)

Federated Learning (FL) is a paradigm for training machine learning (ML) models in collaborative settings while preserving participants' privacy by keeping raw data local. A key requirement for the use of FL in production is reliability, as insufficient reliability can compromise the validity, stability, and reproducibility of learning outcomes. FL inherently operates as a distributed system and is therefore susceptible to crash failures, network partitioning, and other fault scenarios. Despite this, the impact of such failures on FL outcomes has not yet been studied systematically. In this paper, we address this gap by investigating the impact of missing participants in FL. To this end, we conduct extensive experiments on image, tabular, and time-series data and analyze how the absence of participants affects model performance, taking into account influencing factors such as data skewness, different availability patterns, and model architectures. Furthermore, we examine scenario-specific aspects, including the utility of the global model for missing participants. Our experiments provide detailed insights into the effects of various influencing factors. In particular, we show that data skewness has a strong impact, often leading to overly optimistic model evaluations and, in some cases, even altering the effects of other influencing factors.

联邦学习模型可靠性数据偏斜

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。