用稀疏自编码器精准删除视频生成模型中的特定概念,效果更好更安全。
EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders

- 通过分解激活特征为单一语义单元,实现细粒度概念切除。
- 在多个模型上实现近乎完全的概念移除,生成质量下降小于5%。
- 适合需要内容安全控制的AI视频生成应用开发者使用。
文本到视频扩散模型虽具强大生成能力,但训练数据松散导致安全与版权隐患。概念擦除可系统性移除模型中不希望的语义,但现有方法多在粗粒度层面操作,与概念分布特性不符,易造成清除不全或质量下降。本文提出EraseSAE框架,利用稀疏自编码器,在基于DiT的文本到视频扩散模型中实现精细概念擦除。首先引入分块卷积稀疏自编码器,将密集时空激活分解为解耦、可解释的稀疏特征,同时保持时空一致性;再通过对比归因机制,从成对提示中分离出特定概念的特征核;推理时,基于识别出的特征核生成时间步级时空掩码,仅在目标概念活跃区域进行擦除,其余内容不受影响。大量实验表明,EraseSAE在多种模型和任务中均实现精确、鲁棒的概念移除,显著优于当前最优方法,生成质量损失低于5%。代码已公开于https://github.com/HiDream-ai/EraseSAE。
原文摘要 · Abstract (English)
Recent advances in text-to-video (T2V) diffusion models have demonstrated remarkable generative capabilities, yet their reliance on loosely curated training data raises pressing safety and copyright concerns. Concept erasure offers a principled remedy by removing unwanted semantics from pretrained models while preserving remaining concepts. However, existing approaches typically operate at a coarse granularity misaligned with the fine-grained, distributed nature of concept representations, leading to incomplete removal or degraded generation quality. We argue that surgical erasure fundamentally requires intervention at the level of monosemantic features, where each unit encodes a single interpretable concept. To this end, we propose EraseSAE, a novel framework that leverages sparse autoencoders to achieve surgical concept erasure in DiT-based T2V diffusion models via a principled decompose-attribute-erase pipeline. We first introduce the Partitioned Convolutional Sparse Autoencoder, which decomposes dense spatiotemporal activations into disentangled, interpretable sparse features while preserving spatiotemporal coherence. A contrastive attribution mechanism then contrasts activations from paired prompts to isolate concept-specific feature kernels. At inference, timestep-resolved spatiotemporal masks derived from the identified kernels confine erasure to regions where the target concept is active, leaving unrelated content intact. Extensive experiments across diverse diffusion models and concept erasure tasks demonstrate that EraseSAE achieves precise and robust concept removal with minimal quality degradation, substantially outperforming state-of-the-art methods. The code is available at https://github.com/HiDream-ai/EraseSAE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。