arXiv:2605.07841cs.LGcs.AI2026-05被引 1

在敌手主导的去中心化学习中,通过激励机制让恶意节点自保,实现稳定收敛。

\mathsf{VISTA}: Decentralized Machine Learning in Adversary Dominated Environments

论文配图:\mathsf{VISTA}: Decentralized Machine Learning in Adversary Dominated Environments
图 1 · 摘自论文原文
  • 设计动态阈值机制,根据优化历史自适应调整对齐标准。
  • 实验表明,相比固定阈值,该方法加速收敛且更抗恶意干扰。
  • 适用于敌手占多数的高风险去中心化场景,如区块链或边缘计算。

去中心化机器学习常将梯度计算等任务外包给不可信的计算节点。现有鲁棒聚合方法在诚实节点占多数的假设下可缓解恶意行为,但在敌手控制多数节点时失效。本文提出一种基于激励的框架:仅当报告在阈值内相互一致时才接受并奖励。这使敌手从单纯破坏者变为权衡误差与被拒风险的理性参与者。研究迭代优化下的该模型,发现宽松规则虽加快初期进展但易引入污染,严格规则虽提升精度但导致频繁拒绝。为此提出 extsf{VISTA} 算法,利用优化历史动态调节接受阈值。数值结果表明, extsf{VISTA} 改善了收敛性能。进一步提供严谨收敛分析,证明在合理激励自适应下,即使无诚实多数,该学习仍可保持标准 SGD 的渐近收敛性。

原文摘要 · Abstract (English)

Decentralized machine learning often relies on outsourcing computations, such as gradient evaluations, to untrusted worker nodes. Existing robust aggregation methods can mitigate malicious behavior under honest-majority assumptions, but may fail when adversaries control a majority of the workers. We study this adversary-dominated setting through an incentive-oriented framework in which reports are accepted and rewarded only when they are mutually consistent up to a threshold. This turns the adversary from a pure saboteur into a rational agent that trades off increasing estimation error against the risk of rejection and loss of reward. We consider iterative optimization under this model. Unlike one-shot computation, iterative learning requires long-horizon decisions: permissive acceptance rules enable faster early progress but admit more adversarial corruption, while strict rules improve estimation accuracy but cause frequent rejections. We propose \mathsf{VISTA}, an adaptive algorithm that tunes the acceptance threshold using the optimization history. Numerical results show that \mathsf{VISTA} improves convergence over static thresholds. We also provide a rigorous convergence analysis showing that, with suitable incentive-aware adaptation, adversary-dominated decentralized learning can retain the asymptotic convergence behavior of standard SGD without relying on an honest majority.

去中心化学习激励机制对抗鲁棒性自适应算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。