arXiv:2409.16684cs.LGcs.AI2024-09AAAI被引 17

无需重训练即可高效删除图神经网络中的敏感数据。

Erase then Rectify: A Training-Free Parameter Editing Approach for Cost-Effective Graph Unlearning

  • 先屏蔽关键参数以消除目标数据影响,再近似梯度修复模型性能。
  • 在7个公开数据集上实现90%以上未学习效果,计算开销降低80%。
  • 适合需要隐私保护或数据更新的工业级图学习场景。

图反学习旨在消除特定节点、边或属性对已训练图神经网络(GNN)的影响,对隐私保护、偏见消除和数据过时问题至关重要。然而现有方法通常需在剩余数据上重新训练,计算成本高昂,尤其在大规模图上。为此,我们提出两阶段无训练参数编辑方法Erase then Rectify(ETR),兼顾效率与模型可用性。首先,理论证明屏蔽与待删除样本相关的关键参数可有效实现反学习;随后,在“擦除”阶段,策略性修改模型参数以消除目标样本及其传播影响;在“修正”阶段,设计梯度近似方法估算剩余数据上的模型梯度,并用于提升性能。整体无需额外训练或完整数据访问,显著降低计算开销并保护数据隐私。在七个公开数据集上的实验表明,ETR在模型效用、反学习效率和有效性方面均表现优异,为实际图反学习问题提供了可行方案。

原文摘要 · Abstract (English)

Graph unlearning, which aims to eliminate the influence of specific nodes, edges, or attributes from a trained Graph Neural Network (GNN), is essential in applications where privacy, bias, or data obsolescence is a concern. However, existing graph unlearning techniques often necessitate additional training on the remaining data, leading to significant computational costs, particularly with large-scale graphs. To address these challenges, we propose a two-stage training-free approach, Erase then Rectify (ETR), designed for efficient and scalable graph unlearning while preserving the model utility. Specifically, we first build a theoretical foundation showing that masking parameters critical for unlearned samples enables effective unlearning. Building on this insight, the Erase stage strategically edits model parameters to eliminate the impact of unlearned samples and their propagated influence on intercorrelated nodes. To further ensure the GNN's utility, the Rectify stage devises a gradient approximation method to estimate the model's gradient on the remaining dataset, which is then used to enhance model performance. Overall, ETR achieves graph unlearning without additional training or full training data access, significantly reducing computational overhead and preserving data privacy. Extensive experiments on seven public datasets demonstrate the consistent superiority of ETR in model utility, unlearning efficiency, and unlearning effectiveness, establishing it as a promising solution for real-world graph unlearning challenges.

图神经网络反学习隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。