arXiv:2505.17574cs.CV2025-05被引 12

用动态选上下文方法,让AI生成更长视频且保持连贯。

InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPO

  • 自适应选择最相关的上下文令牌,控制计算量
  • 视频长度可扩展9倍,跨场景一致性显著提升
  • 适合需要长视频生成的创作者和研究者

近年来,基于自回归模型的文本到视频生成技术已能合成高质量单场景视频。但将其拓展至长时序、跨场景视频生成仍面临挑战:随着解码过程中上下文长度增加,计算成本急剧上升,模型维持内容一致性和响应动态文本提示的能力下降。本文提出InfLVG,一种推理阶段框架,可在无需额外长视频数据的情况下实现连贯长视频生成。InfLVG通过可学习的上下文选择策略,利用组相对策略优化(GRPO)动态筛选最具语义相关性的上下文。不累积全部生成历史,而是定期对令牌进行排名并保留前K个最相关项,从而在固定计算预算下保持内容一致性和提示对齐。为优化策略,设计混合奖励函数,联合衡量语义对齐、跨场景一致性与伪影减少。为评估性能,构建跨场景视频基准(CsVBench)及事件提示集(EPS),模拟涉及共享主体与多变动作/背景的复杂场景转换。实验表明,InfLVG可将视频长度延长最多9倍,各场景间保持强一致性与语义保真度。代码已公开于https://github.com/MAPLE-AIGC/InfLVG。

原文摘要 · Abstract (English)

Recent advances in text-to-video generation, particularly with autoregressive models, have enabled the synthesis of high-quality videos depicting individual scenes. However, extending these models to generate long, cross-scene videos remains a significant challenge. As the context length grows during autoregressive decoding, computational costs rise sharply, and the model's ability to maintain consistency and adhere to evolving textual prompts deteriorates. We introduce InfLVG, an inference-time framework that enables coherent long video generation without requiring additional long-form video data. InfLVG leverages a learnable context selection policy, optimized via Group Relative Policy Optimization (GRPO), to dynamically identify and retain the most semantically relevant context throughout the generation process. Instead of accumulating the entire generation history, the policy ranks and selects the top-$K$ most contextually relevant tokens, allowing the model to maintain a fixed computational budget while preserving content consistency and prompt alignment. To optimize the policy, we design a hybrid reward function that jointly captures semantic alignment, cross-scene consistency, and artifact reduction. To benchmark performance, we introduce the Cross-scene Video Benchmark (CsVBench) along with an Event Prompt Set (EPS) that simulates complex multi-scene transitions involving shared subjects and varied actions/backgrounds. Experimental results show that InfLVG can extend video length by up to 9$\times$, achieving strong consistency and semantic fidelity across scenes. Our code is available at https://github.com/MAPLE-AIGC/InfLVG.

视频生成长视频一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。