arXiv:2605.15737cs.CV2026-05

提出新方法,精准删除数据同时保护其他知识不被误伤

BARRIER: Bounded Activation Regions for Robust Information Erasure

论文配图:BARRIER: Bounded Activation Regions for Robust Information Erasure
图 1 · 摘自论文原文
  • 将干预从权重转向激活空间几何,用区间算术框定要删区域
  • 在多种模型上实现最强删改效果,且其他知识几乎不受影响
  • 适合需要安全擦除敏感信息的场景,如隐私保护或内容净化

机器遗忘面临关键瓶颈:传统权重修改方法虽能删除特定概念,却常意外抑制其他重要表征,导致知识丢失。这类方法缺乏对中立概念的数学保障,被迫采取保守更新。本文提出BARRIER(有界激活区域鲁棒信息擦除),将干预焦点从静态权重转向隐藏层激活的动态几何结构。通过奇异值分解投影并结合区间算术,在激活空间内构建目标区域的边界超立方体,仅在该遗忘区间内进行更新,并形式化约束补集上的模型响应,确保保留分布的严格保护。这种几何构造使知识保留从经验性假设转变为可优化的目标,具有函数漂移的概率尾界保证。关键在于,此稳定性允许在遗忘区执行高激进更新。实验表明,BARRIER在分类器与扩散模型上均达到最先进水平,在最大化目标概念删除的同时,完整保留所有其他表示。代码已开源。

原文摘要 · Abstract (English)

Machine unlearning has reached a critical bottleneck. As traditional weight-space interventions focus primarily on erasing targeted concepts, they often fail to prevent the unintended suppression of other significant representations. This leads to substantial collateral damage, with essential knowledge being forgotten, because these methods lack formal mathematical guarantees for the preservation of neutral concepts. To avoid degradation, they are frequently forced into conservative updates. We propose BARRIER (Bounded Activation Regions for Robust Information Erasure), a paradigm-shifting framework that shifts the locus of intervention from static model weights to the dynamic geometry of hidden-layer activations. Unlike existing methods, BARRIER employs Interval Arithmetic (IA) on SVD-based projections of the activation space to encapsulate the specific target region within a bounding hypercube. By driving unlearning updates exclusively within this forget interval and mathematically bounding the model response on the complement, we ensure rigorous protection of the retain distribution. This geometric construction transforms the preservation of knowledge from an empirical heuristic into a formal optimization target with a probabilistic tail bound on functional drift. Crucially, this stability permits highly aggressive unlearning updates within the forget region. Empirical evaluations demonstrate that BARRIER matches state-of-the-art trade-offs across classifiers and diffusion models, maximizing targeted concept erasure while safeguarding the integrity of all other representations. Our code is available at https://github.com/OneAndZero24/BARRIER.

机器遗忘知识保护激活空间鲁棒擦除

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。