arXiv:2412.11476cs.LG2024-12被引 17

提出垂直联邦学习中删除单个客户端数据的新方法,无需重训即可实现遗忘。

Vertical Federated Unlearning via Backdoor Certification

  • 通过梯度上升反向优化,提取并移除特定客户端贡献
  • 实验显示效果接近从头重新训练,验证了有效性
  • 无需访问原始数据或存储参数更新,适合隐私敏感场景

垂直联邦学习(VFL)允许不同实体在保持数据隐私的前提下协同训练模型,特别适用于样本标识相同但特征不同的场景。随着隐私法规对‘被遗忘权’的强调,如何从模型中移除特定客户端的数据影响成为关键挑战。本文提出一种新机制,通过反向学习轨迹,利用梯度上升和预设约束模型来优化性能,从而精准剥离单个客户端的贡献。同时引入后门机制验证遗忘效果。该方法无需访问初始训练数据,也不需存储参数更新,实证表明其效果与从头重训高度一致,为VFL中的可遗忘性提供了可行路径。代码已开源:https://github.com/mengde-han/VFL-unlearn。

原文摘要 · Abstract (English)

Vertical Federated Learning (VFL) offers a novel paradigm in machine learning, enabling distinct entities to train models cooperatively while maintaining data privacy. This method is particularly pertinent when entities possess datasets with identical sample identifiers but diverse attributes. Recent privacy regulations emphasize an individual's \emph{right to be forgotten}, which necessitates the ability for models to unlearn specific training data. The primary challenge is to develop a mechanism to eliminate the influence of a specific client from a model without erasing all relevant data from other clients. Our research investigates the removal of a single client's contribution within the VFL framework. We introduce an innovative modification to traditional VFL by employing a mechanism that inverts the typical learning trajectory with the objective of extracting specific data contributions. This approach seeks to optimize model performance using gradient ascent, guided by a pre-defined constrained model. We also introduce a backdoor mechanism to verify the effectiveness of the unlearning procedure. Our method avoids fully accessing the initial training data and avoids storing parameter updates. Empirical evidence shows that the results align closely with those achieved by retraining from scratch. Utilizing gradient ascent, our unlearning approach addresses key challenges in VFL, laying the groundwork for future advancements in this domain. All the code and implementations related to this paper are publicly available at https://github.com/mengde-han/VFL-unlearn.

联邦学习数据遗忘隐私保护梯度上升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。