arXiv:2508.05663stat.MLcs.CR2025-08被引 3

提出防御恶意节点终结随机游走的去中心化复制机制。

Random Walk Learning and the Pac-Man Attack

  • 设计平均穿越算法,通过复制游走路径抵御攻击
  • 理论证明游走数量有界且梯度下降仍收敛
  • 揭示了复制阈值的相变现象,适合分布式学习研究者

基于随机游走(RW)的算法因开销低、可扩展而广泛应用于分布式系统,近年来在去中心化学习中日益普及。然而,其依赖局部交互的特性使其易受恶意行为影响。本文研究一种名为“吃豆人”(Pac-Man)的对抗性威胁:恶意节点会以一定概率终止所有访问它的随机游走。这种隐蔽行为逐步消除网络中的活跃游走,导致学习过程停滞却不会触发故障报警。为应对该威胁,我们提出平均穿越(AC)算法——一种完全去中心化的游走复制机制,可在存在吃豆人攻击时防止游走灭绝。理论分析表明:(i) 在AC下,游走种群几乎必然有界;(ii) 即使存在攻击,基于游走的随机梯度下降仍保持收敛,仅与真实最优解存在可量化的偏差。大量实验结果在合成及真实数据集上验证了上述结论,并发现灭绝概率随复制阈值呈现相变现象。通过对简化版AC的分析,进一步揭示了该相变的内在机制。

原文摘要 · Abstract (English)

Random walk (RW)-based algorithms have long been popular in distributed systems due to low overheads and scalability, with recent growing applications in decentralized learning. However, their reliance on local interactions makes them inherently vulnerable to malicious behavior. In this work, we investigate an adversarial threat that we term the ``Pac-Man'' attack, in which a malicious node probabilistically terminates any RW that visits it. This stealthy behavior gradually eliminates active RWs from the network, effectively halting the learning process without triggering failure alarms. To counter this threat, we propose the Average Crossing (AC) algorithm--a fully decentralized mechanism for duplicating RWs to prevent RW extinction in the presence of Pac-Man. Our theoretical analysis establishes that (i) the RW population remains almost surely bounded under AC and (ii) RW-based stochastic gradient descent remains convergent under AC, even in the presence of Pac-Man, with a quantifiable deviation from the true optimum. Our extensive empirical results on both synthetic and real-world datasets corroborate our theoretical findings. Furthermore, they uncover a phase transition in the extinction probability as a function of the duplication threshold. We offer theoretical insights by analyzing a simplified variant of the AC, which sheds light on the observed phase transition.

分布式学习随机游走安全机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。