arXiv:2609.05976cs.CLcs.AI2026-09

提出多语言大模型去记忆的边界评估基准,解决知识清除范围失控问题。

Beyond Cross-Lingual Transfer: Benchmarking Propagation Boundaries in Multilingual LLM Unlearning

论文配图:Beyond Cross-Lingual Transfer: Benchmarking Propagation Boundaries in Multilingual LLM Unlearning
图 1 · 摘自论文原文
  • 设计双场景评估框架:全语言遗忘与语言限定遗忘
  • 构建800组跨语言知识对与7.2万问答实例,覆盖10种语言
  • 发现现有方法在跨语言传播中存在遗忘不足或过度扩散的致命缺陷

大语言模型去记忆旨在消除特定知识的同时保留通用能力。在多语言场景中,去记忆还需控制知识清除的传播范围。现有评估主要关注跨语言迁移,无法区分传播不足与过度传播。本文提出CLLPU(跨语言语言边界去记忆评估协议),通过两种设定:通用目标遗忘(目标知识在所有语言中被抑制)与语言条件遗忘(抑制仅限指定语言)。CLLPU结合目标引导的主题配对、模式感知的关系匹配和双锚点多语言翻译,构建了800对匹配的知识单元与7.2万个问答实例,覆盖十种语言。在Llama-3.1-8B-Instruct上对六种代表性方法的实验显示:当要求全域抑制时遗忘不彻底,而要求语言限定抑制时又会超出预期边界。进一步发现,通用多语言能力可能掩盖邻近知识的损伤。这些结果确立传播控制是多语言大模型去记忆的核心挑战。我们公开发布CLLPU及其构建流程。

原文摘要 · Abstract (English)

Large Language Model (LLM) unlearning aims to suppress target knowledge while preserving general capabilities. In multilingual settings, unlearning must additionally propagate within its intended linguistic scope. However, existing evaluations mainly measure cross-lingual transfer and cannot distinguish insufficient from excessive propagation. We introduce CLLPU (Cross-Lingual and Language-Bound Protocol for LLM Unlearning), a multilingual benchmark that formulates this problem through two settings: common-goal forgetting, where target knowledge should be suppressed across all languages, and language-conditioned forgetting, where suppression should remain confined to a designated language. CLLPU combines goal-guided topic pairing, schema-aware relation matching, and dual-anchor multilingual translation to construct 800 matched knowledge-unit pairs and 72,000 QA instances across ten languages. Experiments with six representative methods on Llama-3.1-8B-Instruct reveal opposite failure modes: forgetting remains incomplete when universal suppression is required, yet spreads beyond the intended boundary when language-conditioned confinement is required. We further find that general multilingual utility can conceal damage to neighbor knowledge. These findings establish propagation control as a central challenge for multilingual LLM unlearning. We publicly release CLLPU together with its construction pipeline.

大模型去记忆多语言评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。