arXiv:2507.14629cs.CRcs.AI2025-07中稿 · Frontiers of Compu…被引 1

通过层掩码保护垂直联邦学习中的标签隐私,兼顾安全与效率。

VMask: Tunable Label Privacy Protection for Vertical Federated Learning via Layer Masking

  • 用秘密共享技术掩码关键层参数,破坏输入与中间输出的关联。
  • 在多种模型和数据集上实现接近随机猜测的攻击成功率,精度损失仅0.09%。
  • 支持可调隐私预算,运行速度比加密方法快6万倍以上。

尽管垂直联邦学习(VFL)通常被认为具有隐私保护能力,但近期研究发现其易受来自多个攻击面的标签推断攻击。其中,模型完成(MC)攻击是目前最有效的攻击方式。现有防御方法要么牺牲模型精度,要么带来不切实际的计算开销。本文提出VMask,一种基于层掩码的新型标签隐私保护框架,旨在从层掩码角度防御MC攻击。核心思想是利用秘密共享(SS)技术对攻击者模型中的层参数进行掩码,以破坏输入数据与中间输出间的强相关性。我们设计了关键层选择策略,避免对全模型进行掩码,从而降低开销。此外,VMask是首个提供可调隐私预算的框架,使防御者可根据实际需求灵活控制标签隐私水平。我们在自建的VFL系统中实现VMask,使用五种模型架构和13个不同模态的数据集进行了广泛评估,并与12种其他防御方法对比。结果表明,VMask在隐私-效用权衡上表现最佳:成功阻止MC攻击(标签推断准确率降至随机猜测水平),同时保持模型性能(如基于Transformer的模型平均精度下降仅为0.09%)。VMask的运行时间相比基于密码学的方法最高快60,846倍,在大型Transformer模型上仅比标准VFL慢1.8倍,通常可接受。

原文摘要 · Abstract (English)

Though vertical federated learning (VFL) is generally considered to be privacy-preserving, recent studies have shown that VFL system is vulnerable to label inference attacks originating from various attack surfaces. Among these attacks, the model completion (MC) attack is currently the most powerful one. Existing defense methods against it either sacrifice model accuracy or incur impractical computational overhead. In this paper, we propose VMask, a novel label privacy protection framework designed to defend against MC attack from the perspective of layer masking. Our key insight is to disrupt the strong correlation between input data and intermediate outputs by applying the secret sharing (SS) technique to mask layer parameters in the attacker's model. We devise a strategy for selecting critical layers to mask, reducing the overhead that would arise from naively applying SS to the entire model. Moreover, VMask is the first framework to offer a tunable privacy budget to defenders, allowing for flexible control over the levels of label privacy according to actual requirements. We built a VFL system, implemented VMask on it, and extensively evaluated it using five model architectures and 13 datasets with different modalities, comparing it to 12 other defense methods. The results demonstrate that VMask achieves the best privacy-utility trade-off, successfully thwarting the MC attack (reducing the label inference accuracy to a random guessing level) while preserving model performance (e.g., in Transformer-based model, the averaged drop of VFL model accuracy is only 0.09%). VMask's runtime is up to 60,846 times faster than cryptography-based methods, and it only marginally exceeds that of standard VFL by 1.8 times in a large Transformer-based model, which is generally acceptable.

联邦学习隐私保护层掩码安全攻防

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。