一种兼顾隐私与安全的分布式机器学习框架,可同时防御数据泄露和恶意攻击。
Privacy-Preserving and Verifiable Approximate Distributed Coded Computing
- 融合编码计算与抗干扰机制,适配联邦与去中心化学习场景。
- 实测显示隐私泄露降低,对主动攻击的鲁棒性显著提升。
- 适合需要高安全性部署的分布式模型训练应用。
分布式机器学习可在不集中数据的情况下实现协同训练,但易引发隐私泄露和恶意篡改问题。现有防护措施通常孤立应对两类威胁,且多针对特定学习范式或模型架构,限制了实际应用。联邦学习与去中心化学习面临不同的攻击面,却很少在统一框架下解决。本文提出一种模型无关的抗敌对分布式学习框架,联合保障隐私与安全。方法结合领域特定防御机制与GPBACC——一种适用于任意机器学习模型的隐私增强编码计算技术。在联邦学习中,采用鲁棒聚合策略减轻恶意参与者影响;在去中心化学习中,使用近似解码-比对与组测试技术,实现轻量级验证与攻击者隔离,无需可信聚合器。关键的是,通过攻击驱动分析进行评估,实现典型隐私攻击与恶意行为,并实证表明GPBACC结合鲁棒聚合与验证机制能显著降低隐私泄露并提升对主动攻击的韧性。结果表明,隐私增强编码计算结合适当防御策略,为安全分布式机器学习提供了可部署的实用基础。
原文摘要 · Abstract (English)
Distributed machine learning enables collaborative model training without centralizing data, but it also exposes learning processes to privacy leakage and malicious manipulation. Existing defenses typically address these threats in isolation and are often tailored to specific learning paradigms or model architectures, limiting their applicability in realistic deployments. In particular, federated learning and decentralized learning exhibit distinct adversarial surfaces that are rarely addressed within a unified framework. In this paper, we present a model-agnostic framework for adversary-resistant distributed learning that jointly addresses privacy preservation and malicious behavior across both federated and decentralized settings. Our approach combines paradigm-specific defense mechanisms with GPBACC, a privacy-enhancing coded computing technique applicable to arbitrary machine learning models. For federated learning, we integrate robust aggregation strategies to mitigate the impact of malicious participants, while for decentralized learning we employ approximate decode-and-compare and group testing techniques to enable lightweight verification and adversary isolation without relying on a trusted aggregator. Crucially, we evaluate the proposed framework through an explicit, attack-driven analysis. We implement representative privacy attacks and malicious behaviors, and empirically demonstrate that the combination of GPBACC with robust aggregation and verification mechanisms significantly reduces privacy leakage and improves resilience against active adversaries. These results suggest that privacy-enhancing coded computing, when combined with appropriate adversary-resistance strategies, provides a practical and deployable foundation for secure distributed machine learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。