首个图模型遗忘基准,统一评估16种前沿方法
OpenGU: A Comprehensive Benchmark for Graph Unlearning
- 构建首个支持13种GNN、37数据集的图遗忘统一评测框架
- 验证16种方法在多种任务下的遗忘效果,发现8项关键规律
- 适合研究图神经网络隐私与可撤销性的学者参考
图机器学习对理解关系数据至关重要,但隐私敏感场景要求高效移除训练好的图神经网络(GNN)中的敏感信息,避免从头训练带来的时空开销。图遗忘(GU)因此成为关键解决方案,可在数据管理系统中支持动态图更新,并在分布式系统中实现可扩展的遗忘机制,保障隐私合规。然而,由于图数据的非欧几里得特性及GNN的递归消息传递机制,GU面临独特挑战;加之下游任务多样性和遗忘请求复杂性,进一步加剧难题。尽管已有多种GU策略涌现,缺乏公平对比的基准和灵活组合任务与请求的能力,导致评估不一致,阻碍领域发展。为此,我们提出OpenGU,首个图遗忘基准,整合16种先进方法与37个多领域数据集,在13种GNN主干下支持多样化下游任务与灵活遗忘请求。基于此统一框架,我们完成全面公正的评估,通过大量实验得出8项关键结论,揭示现有方法局限,为未来研究指明方向。
原文摘要 · Abstract (English)
Graph Machine Learning is essential for understanding and analyzing relational data. However, privacy-sensitive applications demand the ability to efficiently remove sensitive information from trained graph neural networks (GNNs), avoiding the unnecessary time and space overhead caused by retraining models from scratch. To address this issue, Graph Unlearning (GU) has emerged as a critical solution, with the potential to support dynamic graph updates in data management systems and enable scalable unlearning in distributed data systems while ensuring privacy compliance. Unlike machine unlearning in computer vision or other fields, GU faces unique difficulties due to the non-Euclidean nature of graph data and the recursive message-passing mechanism of GNNs. Additionally, the diversity of downstream tasks and the complexity of unlearning requests further amplify these challenges. Despite the proliferation of diverse GU strategies, the absence of a benchmark providing fair comparisons for GU, and the limited flexibility in combining downstream tasks and unlearning requests, have yielded inconsistencies in evaluations, hindering the development of this domain. To fill this gap, we present OpenGU, the first GU benchmark, where 16 SOTA GU algorithms and 37 multi-domain datasets are integrated, enabling various downstream tasks with 13 GNN backbones when responding to flexible unlearning requests. Based on this unified benchmark framework, we are able to provide a comprehensive and fair evaluation for GU. Through extensive experimentation, we have drawn $8$ crucial conclusions about existing GU methods, while also gaining valuable insights into their limitations, shedding light on potential avenues for future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。