提出一种无需访问删除数据的图模型去记忆方法,高效且保护隐私。
TCGU: Data-centric Graph Unlearning based on Transferable Condensation
- 通过两阶段对齐预压缩图数据,实现数据中心化的去记忆。
- 在6个基准数据集上,模型性能、效率和去记忆效果均优于现有方法。
- 适合需要立即删除数据并保障隐私的场景,如医疗或金融领域。
随着数据隐私与模型鲁棒性需求的增长,图去记忆(Graph Unlearning, GU)——即消除特定数据对训练好的图神经网络(GNN)的影响——受到广泛关注。然而,现有精确去记忆方法存在效率低或模型性能差的问题;而当前近似方法虽更高效且保留更多效用,却无法适用于零凝视隐私场景(即删除样本在去记忆时不可访问,因法规要求立即删除)。此外,这些方法直接扰动模型参数仍带来高隐私风险。为此,我们提出可迁移压缩的图去记忆方法(TCGU),一种数据中心的零凝视图去记忆方案。首先设计两级对齐策略,将原始图预压缩为小规模但效用保持的数据集;收到去记忆请求后,通过低秩插件微调该压缩数据,使其分布与剩余图对齐,从而在不访问删除数据的情况下高效撤销其信息。提出新颖的相似度分布匹配方法与判别正则化器,分别有效实现压缩数据迁移与训练效用保持。最终在迁移后的压缩数据上重新训练GNN。大量实验在6个基准数据集上表明,TCGU在模型效用、去记忆效率和去记忆有效性方面均显著优于现有方法。
原文摘要 · Abstract (English)
With growing demands for data privacy and model robustness, graph unlearning (GU), which erases the influence of specific data on trained GNN models, has gained significant attention. However, existing exact unlearning methods suffer from either low efficiency or poor model performance. While being more utility-preserving and efficient, current approximate unlearning methods are not applicable in the zero-glance privacy setting, where the deleted samples cannot be accessed during unlearning due to immediate deletion requested by regulations. Besides, these approximate methods, which try to directly perturb model parameters still involve high privacy concerns in practice. To fill the gap, we propose Transferable Condensation Graph Unlearning (TCGU), a data-centric solution to zero-glance graph unlearning. Specifically, we first design a two-level alignment strategy to pre-condense the original graph into a small yet utility-preserving dataset. Upon receiving an unlearning request, we fine-tune the pre-condensed data with a low-rank plugin, to directly align its distribution with the remaining graph, thus efficiently revoking the information of deleted data without accessing them. A novel similarity distribution matching approach and a discrimination regularizer are proposed to effectively transfer condensed data and preserve its utility in GNN training, respectively. Finally, we retrain the GNN on the transferred condensed data. Extensive experiments on 6 benchmark datasets demonstrate that TCGU can achieve superior performance in terms of model utility, unlearning efficiency, and unlearning efficacy than existing GU methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。