提出安全去中心化联邦学习框架,用消息历史实现共识与防作恶。
Secure Decentralized Federated Learning via Gossip and Virtual Voting

- 基于节点间传播消息构建有向无环图,通过虚拟投票达成共识。
- 在N=100的网络中,学习效果接近带验证的链上联邦学习,吞吐量提升。
- 可检测异常参与者的虚假模型,适合高安全需求的分布式训练场景。
去中心化联邦学习(DFL)通过节点间点对点消息交换模型更新,摆脱了中心服务器,但现有基于消息广播的方法常缺乏来源终局性,且难以抵御拜占庭或怠惰参与者。链式辅助联邦学习虽增强可审计性,但区块链、分片或结算委员会可能重新引入全局协调开销,违背去中心化局部性原则。本文提出gspDAG-FL,一种安全去中心化联邦学习框架,其共识源自模型传播所用的相同消息历史。节点仅与邻居交换模型载荷,全节点收集事件证书和接收端签署的接受证明,重建紧凑的拓扑有向无环图(DAG),并运行类似Hashgraph的虚拟投票,随后生成紧凑的全节点证书。终局性基于唯一模型来源元组,而非相同的本地参数状态。为提升鲁棒性,gspDAG-FL结合载荷验证、接受证明验证和私有语义审计后再聚合。我们形式化了对抗环境,证明了控制平面的安全性和条件活跃性,并给出了在时变有效混合下经认证扰动消息传播的收敛保证。在MNIST分类与Penn Treebank语言建模任务上的实验表明,使用最多N=100的网络和公平预留验证/审计数据,gspDAG-FL在保持高无效来源检测率的同时,学习质量接近基于验证的链上联邦学习,显著减少协调瓶颈,提升吞吐量。
原文摘要 · Abstract (English)
Decentralized federated learning (DFL) removes the central server by letting nodes exchange model updates through peer-to-peer gossip, but existing gossip-based methods often lack provenance finality and resilience to Byzantine or lazy participants. Ledger-assisted federated learning (FL) improves auditability, yet blockchains, shards, or settlement committees can reintroduce global coordination costs that conflict with DFL locality. This paper proposes \emph{gspDAG-FL}, a secure DFL framework that derives consensus from the same gossip history used to disseminate models. Nodes exchange model payloads only with neighbors, while full nodes collect event certificates and receiver-endorsed accepted gossip proofs, reconstruct a compact Topology directed acyclic graph (DAG), and run Hashgraph-style virtual voting followed by compact full-node certificates. Finality is over unique model-origin tuples, not identical local parameter states. To improve resilience, gspDAG-FL combines payload validation, accepted-proof validation, and private semantic audit before aggregation. We formalize the adversarial setting, prove safety and conditional liveness of the control plane, and give a convergence guarantee for certified perturbed gossip under time-varying effective mixing. Experiments on MNIST classification and Penn Treebank language modeling, using fair held-out validation/audit data and networks up to \(N=100\), show that gspDAG-FL achieves learning quality close to validation-based ledger FL while reducing coordination bottlenecks, improving throughput, and maintaining high invalid-origin detection under mixed Byzantine and lazy participation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。