arXiv:2507.20566cs.AI2025-07

用偏好优化实现知识图谱嵌入的精准去遗忘,解决信息残留与边界知识衰退问题。

Unlearning of Knowledge Graph Embedding via Preference Optimization

  • 将去遗忘重构为偏好优化任务,通过训练模型偏好替代三元组来消除记忆。
  • 在多个数据集上相比基线提升10.1%的平均排名和14.0%的遗忘指标表现。
  • 设计边界召回机制和外部采样策略,有效保护剩余知识完整性,适合知识更新场景。

现有知识图谱(KG)不可避免地包含过时或错误的知识,需从知识图谱嵌入(KGE)模型中移除。现有去遗忘方法分为精确去遗忘和近似去遗忘,但后者在应用中面临两大挑战:(1)由于三元组的内在连接性,仅删除目标三元组仍可被推断,导致信息未完全清除;(2)仅聚焦局部数据,削弱了遗忘边界的剩余知识。为此,我们提出GraphDPO,一种基于直接偏好优化(DPO)的新型近似去遗忘框架。首先,将去遗忘重构为偏好优化问题,通过DPO训练模型偏好重构替代三元组,抑制对可遗忘知识的依赖,缓解因连接性导致的不完全遗忘。其次,引入边界外采样策略构建语义重叠最小的偏好对,弱化遗忘与保留知识间的关联。同时,设计边界回忆机制,在时间步内及跨时间步重放并提炼相关知识。我们在四个主流知识图谱上构建了八个不同去遗忘率的数据集。实验表明,GraphDPO在MRR_Avg上比当前最优基线最高提升10.1%,在MRR_F1上提升14.0%。

原文摘要 · Abstract (English)

Existing knowledge graphs (KGs) inevitably contain outdated or erroneous knowledge that needs to be removed from knowledge graph embedding (KGE) models. To address this challenge, knowledge unlearning can be applied to eliminate specific information while preserving the integrity of the remaining knowledge in KGs. Existing unlearning methods can generally be categorized into exact unlearning and approximate unlearning. However, exact unlearning requires high training costs while approximate unlearning faces two issues when applied to KGs due to the inherent connectivity of triples: (1) It fails to fully remove targeted information, as forgetting triples can still be inferred from remaining ones. (2) It focuses on local data for specific removal, which weakens the remaining knowledge in the forgetting boundary. To address these issues, we propose GraphDPO, a novel approximate unlearning framework based on direct preference optimization (DPO). Firstly, to effectively remove forgetting triples, we reframe unlearning as a preference optimization problem, where the model is trained by DPO to prefer reconstructed alternatives over the original forgetting triples. This formulation penalizes reliance on forgettable knowledge, mitigating incomplete forgetting caused by KG connectivity. Moreover, we introduce an out-boundary sampling strategy to construct preference pairs with minimal semantic overlap, weakening the connection between forgetting and retained knowledge. Secondly, to preserve boundary knowledge, we introduce a boundary recall mechanism that replays and distills relevant information both within and across time steps. We construct eight unlearning datasets across four popular KGs with varying unlearning rates. Experiments show that GraphDPO outperforms state-of-the-art baselines by up to 10.1% in MRR_Avg and 14.0% in MRR_F1.

知识图谱去遗忘偏好优化KGE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。