通过正交投影精准删除有害概念,不破坏正常图像生成能力。
OrthoEraser: Coupled-Neuron Orthogonal Projection for Concept Erasure
- 用稀疏自编码器分解激活特征,分离敏感与正常语义。
- 通过耦合神经元检测定位关键安全区域,实现精准擦除。
- 正交投影保留良性特征,适合安全可控的图像生成应用。
文本到图像(T2I)模型面临恶意诱导带来的安全风险,现有概念擦除方法在抑制特定神经元时常损害良性属性,原因是敏感与良性语义存在非正交叠加,共享激活子空间导致向量纠缠。为此,本文提出OrthoEraser,利用稀疏自编码器(SAE)实现高分辨率特征解耦,并将擦除重新定义为分析性正交化投影,保持良性流形不变。该方法首先用SAE分解密集激活并分离敏感神经元;再通过耦合神经元检测识别易受干扰的非敏感特征;其核心创新在于分析式梯度正交化策略,将擦除向量投影至耦合神经元的零空间,从而正交解耦敏感概念与关键良性子空间,有效保留非敏感语义。在安全性实验中,OrthoEraser实现了高擦除精度,在有效移除有害内容的同时保持生成流形完整性,显著优于当前最优基线。论文包含对不安全模型的实验结果。
原文摘要 · Abstract (English)
Text-to-image (T2I) models face significant safety risks from adversarial induction, yet current concept erasure methods often cause collateral damage to benign attributes when suppressing selected neurons entirely. This occurs because sensitive and benign semantics exhibit non-orthogonal superposition, sharing activation subspaces where their respective vectors are inherently entangled. To address this issue, we propose OrthoEraser, which leverages sparse autoencoders (SAE) to achieve high-resolution feature disentanglement and subsequently redefines erasure as an analytical orthogonalization projection that preserves the benign manifold's invariance. OrthoEraser first employs SAE to decompose dense activations and segregate sensitive neurons. It then uses coupled neuron detection to identify non-sensitive features vulnerable to intervention. The key novelty lies in an analytical gradient orthogonalization strategy that projects erasure vectors onto the null space of the coupled neurons. This orthogonally decouples the sensitive concepts from the identified critical benign subspace, effectively preserving non-sensitive semantics. Experimental results on safety demonstrate that OrthoEraser achieves high erasure precision, effectively removing harmful content while preserving the integrity of the generative manifold, and significantly outperforming SOTA baselines. This paper contains results of unsafe models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。