发现垂直联邦学习中标签推断攻击的漏洞根源并提出零开销防御方法
Revisiting Label Inference Attacks in Vertical Federated Learning: Why They Are Vulnerable and How to Defend
- 揭示底部模型仅提取特征,顶部模型负责标签映射的补偿现象
- 证明标签推断攻击依赖特征与标签分布对齐,破坏对齐可使攻击失效
- 提出层调整防御法,无需额外计算开销即可增强抗攻击能力
垂直联邦学习(VFL)中,主动方拥有顶层模型,多个被动方拥有底层模型,协同训练。被动方仅掌握特征信息,可能试图推断主动方的私有标签,导致标签推断攻击(LIA)成为严重威胁。以往研究认为训练良好的底层模型能有效表征标签,但本文指出这一观点具有误导性,暴露了现有攻击的脆弱性。通过互信息分析,首次发现VFL中的“模型补偿”现象:层输出与标签的互信息随层数加深而增加,表明底层模型主要提取特征,而顶层模型完成标签映射。基于此,我们提出任务重分配,证明现有LIA的成功源于特征与标签的分布对齐;一旦对齐被破坏,攻击性能急剧下降甚至完全失败。进一步探讨防御意义,提出一种零开销防御策略——层调整。在五个数据集和五种代表性模型架构上的实验表明,将切分层前移、增加顶层模型比例,不仅能显著提升抗LIA能力,还能增强其他防御手段效果。
原文摘要 · Abstract (English)
Vertical federated learning (VFL) allows an active party with a top model, and multiple passive parties with bottom models to collaborate. In this scenario, passive parties possessing only features may attempt to infer active party's private labels, making label inference attacks (LIAs) a significant threat. Previous LIA studies have claimed that well-trained bottom models can effectively represent labels. However, we demonstrate that this view is misleading and exposes the vulnerability of existing LIAs. By leveraging mutual information, we present the first observation of the "model compensation" phenomenon in VFL. We theoretically prove that, in VFL, the mutual information between layer outputs and labels increases with layer depth, indicating that bottom models primarily extract feature information while the top model handles label mapping. Building on this insight, we introduce task reassignment to show that the success of existing LIAs actually stems from the distribution alignment between features and labels. When this alignment is disrupted, the performance of LIAs declines sharply or even fails entirely. Furthermore, the implications of this insight for defenses are also investigated. We propose a zero-overhead defense technique based on layer adjustment. Extensive experiments across five datasets and five representative model architectures indicate that shifting cut layers forward to increase the proportion of top model layers in the entire model not only improves resistance to LIAs but also enhances other defenses.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。