让概念擦除更精准,避免误伤其他信息。
MANCE: Manifold Aware Concept Erasure

- 在自然表示流形上约束擦除操作,减少对其他概念的干扰。
- 在119个文本与视觉任务中验证,显著降低概念泄漏率。
- 适合需要高精度概念删除的研究者,如模型可解释性与隐私保护。
概念擦除旨在移除表示中的特定概念,同时保留其他信息。由于概念间常存在相关性,直接移除目标概念易损伤其他信息。我们提出流形约束假设(MCH):若自然表示集中在结构化的低维流形上,则干预应限制在此流形内,以更好保留其他信息。基于此,我们提出新方法MANCE,通过分类器信号迭代更新表示,并利用自然输入的表示估计流形,将擦除更新投影至该流形。我们在119个设置中评估,涵盖13个语言模型、3个NLP概念及40个CelebA-CLIP属性。在已有方法基础上使用MANCE,持续提升泄漏性能。我们还引入MANCE+和MANCE++,前者在MANCE前加入闭式擦除,后者实现更优的泄漏-精准度权衡。MANCE++在非线性概念擦除上达到当前最优效果,支持了在擦除任务中干预应受限于自然表示流形的假设。
原文摘要 · Abstract (English)
Concept erasure aims to remove a target concept from a representation while preserving the other information encoded in it. This is difficult because representations encode many concepts that are often correlated with the erasure target, so removing the target risks damaging them. We propose the Manifold Constraint Hypothesis (MCH): if natural representations concentrate on a structured, lower-dimensional manifold, then interventions should be constrained to that manifold and better preserve other information encoded in the representation during interventions. We instantiate MCH in a new concept erasure method: MANifold aware Concept Erasure (MANCE). MANCE performs iterative updates to the representations using signals from a classifier that predicts a target concept. We estimate the manifold using representations obtained from natural inputs, and then we project the concept removal update to the estimated manifold. We perform extensive evaluation on 119 settings spanning text and vision, including 13 language models, three NLP concepts, and 40 CelebA-CLIP attributes. Employing MANCE on top of previous methods shows consistent improved leakage results. We also introduce MANCE+ and MANCE++, which prepend a closed-form erasure algorithm before employing MANCE, achieving better leakage--surgicality tradeoffs relative to matched full-space updates. MANCE++, our best method, achieves state-of-the-art results on nonlinear concept erasure. These results support MCH in the erasure setting: interventions should be constrained to the natural representation manifold.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。