arXiv:2605.18733cs.CV2026-05被引 4

无需训练的框架,让长视频生成保持角色一致性。

Advancing Narrative Long Video Generation via Training-Free Identity-Aware Memory

论文配图:Advancing Narrative Long Video Generation via Training-Free Identity-Aware Memory
图 1 · 摘自论文原文
  • 用大模型提取实体并分配唯一ID,实现显式身份追踪。
  • 在60秒多提示场景下比最强基线快1.39倍,性能领先2.56分。
  • 适合需要长期角色一致性的视频生成研究者使用。

自回归视频生成在视觉保真度和交互性方面快速进步,但仍面临长期不一致和记忆退化问题。现有方法或使用预定义策略压缩历史帧,或基于粗略隐式注意力信号检索关键帧,均难以应对提示变化中的实体指代转移,导致身份漂移、角色重复和属性丢失。为此,我们提出IAMFlow——一种无需训练的身份感知记忆框架,可显式建模并追踪持久实体身份,实现跨提示转换的一致生成。具体而言,大语言模型从每个提示中提取带有视觉属性的实体并分配唯一全局ID,用于身份感知记忆;视觉语言模型则异步验证并优化渲染帧中的属性,以显式追踪取代隐式相似匹配。为保证计算可行性,我们设计了包括异步视觉验证、自适应提示转换和模型量化在内的系统推理加速管道,生成速度优于现有基线。此外,我们引入NarraStream-Bench,一个面向叙事流视频生成的基准,包含324个跨六维度的多提示脚本及三维评估协议,融合传统指标与多模态大模型评估。大量实验表明,尽管是训练自由的,IAMFlow在NarraStream-Bench上整体表现最佳,比最强基线高2.56分,且在60秒多提示设置下比最高效基线快1.39倍。

原文摘要 · Abstract (English)

Autoregressive video generation has improved rapidly in visual fidelity and interactivity, but it still suffers from long-term inconsistency and memory degradation. Most existing solutions either compress historical frames using predefined strategies or retrieve keyframes based on coarse implicit attention signals, both of which fail to handle evolving prompts with shifting entity references, leading to identity drift, character duplication, and attribute loss. To address this, we propose IAMFlow, a training-free identity-aware memory framework that explicitly models and tracks persistent entity identities, enabling consistent generation across prompt transitions. Specifically, an LLM extracts entities with visual attributes from each prompt and assigns unique global IDs for identity-aware memory, while a VLM asynchronously verifies and refines attributes from rendered frames, enabling explicit entity tracking in place of implicit similarity-based matching. To keep the proposed framework computationally practical, we design a systematic inference acceleration pipeline, including asynchronous visual verification, adaptive prompt transition, and model quantization, which achieves faster generation than existing baselines. Furthermore, we introduce NarraStream-Bench, a benchmark for narrative streaming video generation that features 324 multi-prompt scripts spanning six dimensions and a three-dimensional evaluation protocol that integrates both traditional metrics and multimodal large language model-based assessments. Extensive experiments show that IAMFlow, despite being training-free, achieves the best overall performance on NarraStream-Bench, outperforming the strongest baseline by 2.56 points, while achieving a 1.39$\times$ speedup over the most efficient baseline in the 60-second multi-prompt setting.

视频生成身份追踪推理加速长视频

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。