arXiv:2605.14382cs.CVcs.GR2026-05

解决视频生成中响应快却易出错的问题,让画面更连贯稳定。

Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generation

论文配图:Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generation
图 1 · 摘自论文原文
  • 用信任区域约束教师指导,防止生成偏离轨迹。
  • 在10秒内响应新事件,且长时间保持画面一致性。
  • 适合需要实时互动的视频创作与虚拟世界建模场景。

交互式实时自回归视频生成对内容创作和世界建模等应用至关重要,要求视觉内容能随动态事件变化而调整。核心挑战在于平衡反应速度与稳定性:模型需快速响应新事件,同时保持长时程的时间连贯性。现有方法将双向模型蒸馏为自回归生成器并进行流式微调,但条件变化后常出现持续漂移。我们发现根源在于条件偏差——教师模型可能提供符合当前条件但不考虑轨迹一致性的指导,导致生成局部合理却全局不一致的模式。受信任区域策略优化启发,我们提出Delta Forcing,一种简单有效的框架,通过自适应信任区域约束不可靠的教师监督。具体而言,该方法从教师与生成器轨迹间的潜在差分中估计转移一致性,并据此平衡教师指导与单调连续性目标。这有效抑制了教师引发的非可靠偏移,同时保持对新事件的敏感性。大量实验表明,Delta Forcing显著提升生成一致性,同时维持事件响应能力。

原文摘要 · Abstract (English)

Interactive real-time autoregressive video generation is essential for applications such as content creation and world modeling, where visual content must adapt to dynamically evolving event conditions. A fundamental challenge lies in balancing reactivity and stability: models must respond promptly to new events while maintaining temporal coherence over long horizons. Existing approaches distill bidirectional models into autoregressive generators and further adapt them via streaming long tuning, yet often exhibit persistent drift after condition changes. We identify the cause as conditional bias, where the teacher may provide condition-aligned but trajectory-agnostic guidance, biasing generation toward locally valid yet globally inconsistent modes. Inspired by Trust Region Policy Optimization, we propose Delta Forcing, a simple yet effective framework that constrains unreliable teacher supervision within an adaptive trust region. Specifically, Delta Forcing estimates transition consistency from the latent delta between teacher and generator trajectories, and uses it to balance teacher supervision with a monotonic continuity objective. This suppress unreliable teacher-induced shifts while preserving responsiveness to new events. Extensive experiments demonstrate that Delta Forcing significantly improves consistency while maintaining event reactivity.

视频生成自回归模型交互式生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。