arXiv:2605.25941cs.CV2026-05中稿 · ICML

找到文本到视频模型中概念消除的最佳层,提升消隐精度

Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Models

论文配图:Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Models
图 1 · 摘自论文原文
  • 根据概念与非目标信号分离程度,优化选择消除层
  • 在关键层消除概念后,生成质量保持不变,但消隐更精准
  • 适合需要精确控制生成内容的视频生成研究者

文本到视频扩散模型在不同深度编码语义信息不均,限制了有效概念消除。我们发现一个表征瓶颈,称为概念层拓扑对齐,在某些表示深度下目标概念具有更高可分性。在此之外,概念与非目标信号仍高度纠缠,制约了基于深度的消除效果。这一观察将概念消除重构为识别概念-非目标分离自然出现的表征深度问题。为此,我们提出CLEAR,一种以可分性驱动的优化框架,显式强制概念层对齐。CLEAR将层选择建模为概念-非目标可分性的优化问题,而非依赖无层或启发式选择。我们引入可分性感知目标,偏好表现出更强分离的层。大规模文本到视频扩散模型实验表明,强制概念-层对齐可实现更精确的概念抑制,同时保持整体生成质量。

原文摘要 · Abstract (English)

Text-to-video diffusion transformers encode semantic information unevenly across model depth, which constrains effective concept erasure. We identify a representational bottleneck, termed concept-layer topological alignment, under which target concepts exhibit higher separability at certain representational depths. Outside these depths, concept and non-target signals remain strongly entangled, limiting the effectiveness of depth-specific erasure. This observation reframes concept erasure as the problem of identifying representational depths where concept-non-target separation naturally emerges. Motivated by this structural constraint, we introduce CLEAR, a separability-driven optimization framework for concept erasure that explicitly enforces concept-layer alignment. CLEAR operationalizes this principle by formulating layer selection as an optimization problem over concept-non-target separability, rather than relying on layer-agnostic or heuristic choices. To enable this, we introduce a separability-aware objective that favors layers exhibiting stronger concept-non-target separation. Experiments on large-scale text-to-video diffusion models demonstrate that enforcing concept--layer alignment leads to more precise concept suppression while preserving overall generative quality.

文本生成视频概念消除扩散模型表征对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。