用信任分与试验函数抵御恶意节点,即使多数节点被攻破也能保持模型收敛。
Bant: Byzantine Antidote via Trial Function and Trust Scores
- 引入信任分与试验函数动态识别并过滤异常更新。
- 在多数节点被攻破时仍能保证模型收敛,优于传统方法。
- 兼容Adam、RMSProp等优化器,适用于局部训练和部分参与场景。
机器学习性能提升的同时计算需求增加。联邦与分布式架构虽缓解此问题,但易受恶意攻击影响。本文针对拜占庭攻击——即受损客户端注入对抗性更新以破坏全局收敛——提出新方法:结合信任分与试验函数动态过滤异常值。该方法克服了以往方案的局限性,可在拜占庭节点占多数时正常运行。算法还适配主流缩放优化器(如Adam、RMSProp)及实际场景,包括本地训练与部分参与。通过在公开数据集与医疗机构采集的私有心电图数据上进行大量实验,验证了方法的鲁棒性。此外,提供了广泛的理论分析,涵盖前述实用场景。所提方法的收敛保证与无拜占庭干扰的经典算法相当。
原文摘要 · Abstract (English)
Recent advancements in machine learning have improved performance while also increasing computational demands. While federated and distributed setups address these issues, their structures remain vulnerable to malicious influences. In this paper, we address a specific threat: Byzantine attacks, wherein compromised clients inject adversarial updates to derail global convergence. We combine the concept of trust scores with trial function methodology to dynamically filter outliers. Our methods address the critical limitations of previous approaches, allowing operation even when Byzantine nodes are in the majority. Moreover, our algorithms adapt to widely used scaled methods such as Adam and RMSProp, as well as practical scenarios, including local training and partial participation. We validate the robustness of our methods by conducting extensive experiments on both public datasets and private ECG data collected from medical institutions. Furthermore, we provide a broad theoretical analysis of our algorithms and their extensions to the aforementioned practical setups. The convergence guaranties of our methods are comparable to those of classical algorithms developed without Byzantine interference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。