针对大规模删图导致模型性能骤降的问题,提出分阶段渐进式遗忘方法。
CUNO: Curriculum and Preference Optimization for Stable Graph Unlearning under Mass Deletion

- 按遗忘难度分阶段删除节点,避免一刀切式遗忘。
- 20%删减时保留74%原始性能,50%时仍超50%。
- 适合需要频繁删改图数据的场景,如隐私保护与动态更新。
图模型遗忘旨在不从头训练的情况下移除特定训练数据的影响。然而,现有方法在高比例删除(即大规模删除)下会出现性能急剧下降,我们称之为灾难性遗忘。研究发现,其主要原因是对所有待删样本采用统一遗忘操作——而图结构中不同节点对模型的影响差异巨大,统一处理会破坏关键结构。为此,我们提出CUNO,一种基于课程学习的图遗忘框架:按估计的遗忘难度分多阶段逐步删除节点。每个阶段引入分布级负偏好优化(NPO)目标,引导模型远离原行为但保持未删节点的性能。理论分析表明,当待删集包含广泛遗忘难度时,课程设计最有效,这在大规模删除下自然满足。大量实验验证,CUNO显著缓解灾难性遗忘:在20%删除率下保留74%原始性能,优于现有方法的26-53%;即使在50%删除率下仍保持超过一半原始性能。代码已公开于https://anonymous.4open.science/r/cuno-D4FF。
原文摘要 · Abstract (English)
Graph unlearning removes the influence of designated training data from a trained graph model without retraining from scratch. However, existing methods suffer a sharp drop in model utility under large deletion ratios (mass deletion), a phenomenon we refer to as catastrophic unlearning. We find that a key cause is the uniform treatment of all deleted samples, which is particularly damaging in graph learning: structural dependencies cause different nodes to play vastly different roles in the learned model, yet existing methods apply the same forgetting operation to the entire forget set. Based on this insight, we propose CUNO, a curriculum-based graph unlearning framework that removes the forget set progressively, ordering samples by their estimated unlearning difficulty across multiple stages. CUNO further employs a distribution-level negative preference optimization (NPO) objective at each curriculum stage that steers the model away from its original behavior on the current forget subset while preserving retained performance. Our theoretical analysis shows that the curriculum design is most beneficial when the forget set spans a wide range of unlearning difficulty, a condition naturally satisfied under mass deletion. Comprehensive experiments confirm that CUNO consistently mitigates catastrophic unlearning: at 20% deletion, it retains 74% of the original utility compared to 26-53% for existing methods, and maintains more than half the original utility even at 50% deletion. Our code is publicly available at https://anonymous.4open.science/r/cuno-D4FF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。