arXiv:2510.19479cs.LGcs.AI2025-10被引 4

提出INPO框架,让图模型在删除数据时更稳定、效果更好。

Graph Unlearning Meets Influence-aware Negative Preference Optimization

  • 基于影响感知设计消息传递机制,减缓删除数据时的模型漂移
  • 在5个真实数据集上实现最优遗忘质量,同时保持模型性能
  • 适合需要安全删除数据且不牺牲模型可用性的研究者

近期图模型去学习方法通过梯度上升更新遗忘节点,虽能保持表示不变,但导致模型性能急剧下降。本文提出一种影响感知负偏好优化框架INPO,旨在减缓梯度上升带来的快速发散。我们分析发现负偏好优化(NPO)发散较慢,并理论证明删除高影响力边可降低遗忘影响。为此,设计了影响感知的消息函数,增强被遗忘边的影响,缓解遗忘集与保留集间的拓扑耦合。边的影响通过移除法快速估计。此外,从拓扑角度引入拓扑熵损失,防止局部结构信息过度丢失。在五个真实世界数据集上的大量实验表明,基于INPO的模型在所有遗忘质量指标上均达到领先水平,同时维持了模型性能。代码已开源。

原文摘要 · Abstract (English)

Recent advancements in graph unlearning models have enhanced model utility by preserving the node representation essentially invariant, while using gradient ascent on the forget set to achieve unlearning. However, this approach causes a drastic degradation in model utility during the unlearning process due to the rapid divergence speed of gradient ascent. In this paper, we introduce \textbf{INPO}, an \textbf{I}nfluence-aware \textbf{N}egative \textbf{P}reference \textbf{O}ptimization framework that focuses on slowing the divergence speed and improving the robustness of the model utility to the unlearning process. Specifically, we first analyze that NPO has slower divergence speed and theoretically propose that unlearning high-influence edges can reduce impact of unlearning. We design an influence-aware message function to amplify the influence of unlearned edges and mitigate the tight topological coupling between the forget set and the retain set. The influence of each edge is quickly estimated by a removal-based method. Additionally, we propose a topological entropy loss from the perspective of topology to avoid excessive information loss in the local structure during unlearning. Extensive experiments conducted on five real-world datasets demonstrate that INPO-based model achieves state-of-the-art performance on all forget quality metrics while maintaining the model's utility. Codes are available at \href{https://github.com/sh-qiangchen/INPO}{https://github.com/sh-qiangchen/INPO}.

图神经网络去学习拓扑优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。