arXiv:2607.26706cs.CV2026-07

解决文本生成视频时后期事件被早期内容压制的问题。

TPD: Temporal Prior Decoupling for Text-to-Video Diffusion Models

论文配图:TPD: Temporal Prior Decoupling for Text-to-Video Diffusion Models
图 1 · 摘自论文原文
  • 通过构建时间反事实,分离并恢复被压制的后期信号
  • 在不重训练的情况下显著提升后期概念生成效果
  • 适用于多种视频生成模型,无需修改主干网络

文本到视频扩散模型能从自然语言生成连贯视频,但在描述先出现的场景持续存在、后出现新事件时(如“高沙堡立于海滩,海浪涌来将其冲毁”),常无法在对应帧中实现后期事件。我们发现这是由于早期内容的主导先验抑制了后期事件的引导信号,现有方法未建模此竞争机制。为此提出无需训练的时序先验解耦(TPD)框架:通过仅依赖早期内容构建时间反事实,将完整提示与反事实轨迹的差异定义为被抑制信号方向。不同于以往减法投影方法移除该方向,TPD通过帧选择性下界约束,在扩散步和视频帧上联合求解,恢复被压制的信号,使后期事件得以实现而不破坏早期一致性。相比以往强制上界可行性以消除无关语义,TPD强制下界可行性以确保被抑制信号贡献。整个过程完全运行于标准扩散采样中,仅基于无分类器引导空间,天然具备主干无关性。实验表明,TPD显著提升后期概念实现率,同时保持时空连贯性和视觉保真度,且该抑制现象在不同文本到视频主干中反复出现。

原文摘要 · Abstract (English)

Text-to-video diffusion models generate temporally coherent content from natural language, yet when a prompt describes an early scene that persists while a new event emerges on top of it---such as "a tall sandcastle standing on a beach where a wave rushes in and washes it away"---generation frequently fails to realize the late-segment event in the corresponding frames. We identify this failure as Temporal Prior Suppression (TPS): the dominant prior of the early segment captures the cross-attention trajectory across the temporal axis and suppresses the guidance signal needed for late-segment realization, a competing tendency existing guidance mechanisms do not model. We introduce Temporal Prior Decoupling (TPD), a training-free framework that restores suppressed late-segment signals during diffusion sampling. TPD constructs a temporal counterfactual by conditioning on the early segment alone, and defines the discrepancy between the full-prompt and counterfactual trajectories as a suppressed signal direction. Rather than removing this direction as in prior subtractive projection methods, TPD restores it through a frame-selective lower-bound constraint resolved jointly over diffusion timestep and video frame, realizing the suppressed event in the late frames without disrupting early-segment coherence: where prior work enforces upper-bound feasibility to remove unwanted semantics, TPD enforces lower-bound feasibility to guarantee suppressed-signal contribution. TPD runs entirely within standard diffusion sampling without retraining, and is defined purely in classifier-free guidance space, making it backbone-agnostic by construction. Experiments show that TPD significantly improves late-concept realization while preserving temporal coherence and visual fidelity, and that the targeted suppression recurs across distinct text-to-video backbones.

视频生成扩散模型时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。