arXiv:2601.10705cs.LG2026-01

解决分布式感知机在延迟、部分参与和通信噪声下的误判问题。

Distributed Perceptron under Bounded Staleness, Partial Participation, and Noisy Communication

  • 设计了基于延迟桶的聚合规则,精确控制更新延迟分布。
  • 证明了累计误判次数在有限轮次内有界,噪声影响随根号增长。
  • 适用于存在系统延迟与不完整设备参与的联邦学习场景。

我们研究一种半异步客户端-服务器感知机,通过迭代参数混合(IPM式平均)训练:客户端执行本地感知机更新,服务器在每轮通信中聚合到达的更新形成全局模型。该设置捕捉联邦与分布式部署中的三大系统效应:(i) 因模型下发延迟与客户端计算应用延迟导致的旧化更新(双向版本滞后),(ii) 部分参与(客户端间歇性不可用),(iii) 上下行通信不完美,建模为具有有界二阶矩的零均值加性噪声。我们提出一种服务器端聚合规则——延迟桶填充聚合,可确定性地实现预设的延迟分布,无需对延迟或参与率假设随机模型。在间隔可分且数据半径有界的条件下,我们证明了在给定服务器轮次内累积加权误判次数的有限时域期望上界:延迟影响仅通过平均强制延迟体现;通信噪声则引入一项随时间平方根增长的额外项,其大小与总噪声能量相关。在无噪声情况下,我们展示了有限期望误判预算如何在温和的新鲜参与条件下导出有限轮次稳定界限。

原文摘要 · Abstract (English)

We study a semi-asynchronous client-server perceptron trained via iterative parameter mixing (IPM-style averaging): clients run local perceptron updates and a server forms a global model by aggregating the updates that arrive in each communication round. The setting captures three system effects in federated and distributed deployments: (i) stale updates due to delayed model delivery and delayed application of client computations (two-sided version lag), (ii) partial participation (intermittent client availability), and (iii) imperfect communication on both downlink and uplink, modeled as effective zero-mean additive noise with bounded second moment. We introduce a server-side aggregation rule called staleness-bucket aggregation with padding that deterministically enforces a prescribed staleness profile over update ages without assuming any stochastic model for delays or participation. Under margin separability and bounded data radius, we prove a finite-horizon expected bound on the cumulative weighted number of perceptron mistakes over a given number of server rounds: the impact of delay appears only through the mean enforced staleness, whereas communication noise contributes an additional term that grows on the order of the square root of the horizon with the total noise energy. In the noiseless case, we show how a finite expected mistake budget yields an explicit finite-round stabilization bound under a mild fresh-participation condition.

分布式学习感知机系统延迟联邦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。