提出距离敏感度分析框架,评估不同加密策略对梯度反演攻击的防御效果。
Evaluating Selective Encryption Against Gradient Inversion Attacks
- 基于梯度距离设计选择性加密机制,仅加密关键数据
- 梯度幅度在多数攻击中表现最优,可降低计算开销
- 提供适配不同模型与隐私需求的选型指南
梯度反演攻击对联邦学习等分布式训练框架构成严重隐私威胁,恶意方可通过客户端与聚合服务器间传输的梯度信息重构敏感本地数据。传统加密方法如同态加密虽能保障隐私且不损失模型性能,但计算开销过高。为此,选择性加密通过仅对梯度中重要部分加密成为可行方案,但如何定义“重要性”尚无系统研究。本文系统评估了不同重要性度量下的选择性加密对前沿攻击的防御效果。实验覆盖LeNet、CNN、BERT、GPT-2等多种模型架构及多种攻击类型,结果表明:在保持抗攻击能力的同时,选择性加密可显著降低计算开销。我们提出基于距离的重要性分析框架,为关键梯度元素的选择提供理论支持。发现梯度幅度是抵御优化类梯度反演攻击的通用有效指标,但不存在适用于所有攻击场景的统一策略,因此给出针对不同模型和隐私要求的选型建议。
原文摘要 · Abstract (English)
Gradient inversion attacks pose significant privacy threats to distributed training frameworks such as federated learning, enabling malicious parties to reconstruct sensitive local training data from gradient communications between clients and an aggregation server during the aggregation process. While traditional encryption-based defenses, such as homomorphic encryption, offer strong privacy guarantees without compromising model utility, they often incur prohibitive computational overheads. To mitigate this, selective encryption has emerged as a promising approach, encrypting only a subset of gradient data based on the data's significance under a certain metric. However, there have been few systematic studies on how to specify this metric in practice. This paper systematically evaluates selective encryption methods with different significance metrics against state-of-the-art attacks. Our findings demonstrate the feasibility of selective encryption in reducing computational overhead while maintaining resilience against attacks. We propose a distance-based significance analysis framework that provides theoretical foundations for selecting critical gradient elements for encryption. Through extensive experiments on different model architectures (LeNet, CNN, BERT, GPT-2) and attack types, we identify gradient magnitude as a generally effective metric for protection against optimization-based gradient inversions. However, we also observe that no single selective encryption strategy is universally optimal across all attack scenarios, and we provide guidelines for choosing appropriate strategies for different model architectures and privacy requirements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。