arXiv:2506.01386cs.LG2025-06中稿 · TMLR被引 2

提出新评估框架,检测大模型编辑后隐藏的知识泄露问题。

ThinkEval: Practical Evaluation of Knowledge Leakage in LLM Editing using Thought-based Knowledge Graphs

  • 构建思维级知识图谱,分析编辑前后事实间的因果关系。
  • 五种编辑方法均难以同时压制间接泄露与保留相关知识。
  • 发布多步推理数据集KnowGIC,支持复杂知识演化研究。

稳健的模型编辑技术对大语言模型(LLM)的实际应用至关重要,可有效应对隐私泄露、偏见消除和虚假信息传播等挑战。例如,医疗辅助LLM需更新过时或错误知识以避免有害建议。然而,现有编辑方法多聚焦孤立事实,无法防范间接知识泄露——即通过持续存在的因果链和上下文关系重建被删除的信息。为此,我们提出ThinkEval框架,系统量化编辑过程中的间接知识泄露与涟漪效应。该框架构建并利用专用知识图谱,分析编辑前后的事实因果结构。为支持此方法,我们发布KnowGIC基准数据集,包含多步推理路径,精准衡量复杂知识转化效果。我们在多个LLM上评估了五种编辑技术:AlphaEdit、RECT、ROME、MEMIT和PRUNE。结果表明,这些方法难以在抑制间接事实泄露与保持相关知识完整性之间取得平衡,损害了模型知识的上下文一致性。数据集地址:https://github.com/manitbaser/KnowGIC。

原文摘要 · Abstract (English)

Robust model-editing techniques are essential for deploying large language models (LLMs) in practical applications, as they enable cost-effective ways to deal with challenges such as privacy breaches, bias mitigation and misinformation spread. For example, an LLM-based healthcare assistance may need to update out-dated or incorrect knowledge to prevent harmful recommendations. However, many editing techniques focus on isolated facts, which critically fail to prevent indirect knowledge leakage -- the unintended reconstruction of edited-out information through persistent causal links and contextual relationships. To assist users in selecting the right editing technique, we develop and present ThinkEval, a framework to systematically quantify indirect knowledge leakage and ripple effects in model-editing. ThinkEval builds and employs specialized knowledge graphs to analyze the causal structure of facts before and after editing. To support this approach, we present KnowGIC, a benchmark dataset comprising multi-step reasoning paths that precisely measure these complex knowledge transformation effects. We evaluate five editing techniques: AlphaEdit, RECT, ROME, MEMIT, and PRUNE across multiple LLMs. Our results show that these techniques struggle to balance indirect fact suppression with the preservation of related knowledge, compromising the contextual integrity of a model's knowledge. Our dataset is available at: https://github.com/manitbaser/KnowGIC.

模型编辑知识泄露知识图谱评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。