arXiv:2508.07603cs.CV2025-08中稿 · ACM MM 2025被引 3

让视频生成更保真人脸特征,解决角色一致性难题

LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creation

  • 局部路由机制显式建模面部结构,减少特征干扰
  • 时序自回归模块提升帧间身份一致性,生成更连贯视频
  • 适合需要高保真人脸视频生成的场景,如虚拟偶像

本文提出LaVieID,一种新型局部自回归视频扩散框架,用于解决文本到视频生成中的人物身份保持难题。现有扩散变换器(DiTs)在全局随机生成过程中易丢失身份信息。LaVieID从空间和时间双角度缓解此问题:首先引入局部路由器,通过细粒度面部结构的加权组合显式表示潜在状态,减少不良特征干扰,增强对独特面部特征的捕捉;其次,集成时序自回归模块,在解码前对潜在令牌进行逐段划分并利用长时序依赖关系预测修正偏置,显著提升帧间身份一致性。实验表明,LaVieID可生成高质量个性化视频,并达到当前最优性能。代码与模型已开源。

原文摘要 · Abstract (English)

In this paper, we present LaVieID, a novel \underline{l}ocal \underline{a}utoregressive \underline{vi}d\underline{e}o diffusion framework designed to tackle the challenging \underline{id}entity-preserving text-to-video task. The key idea of LaVieID is to mitigate the loss of identity information inherent in the stochastic global generation process of diffusion transformers (DiTs) from both spatial and temporal perspectives. Specifically, unlike the global and unstructured modeling of facial latent states in existing DiTs, LaVieID introduces a local router to explicitly represent latent states by weighted combinations of fine-grained local facial structures. This alleviates undesirable feature interference and encourages DiTs to capture distinctive facial characteristics. Furthermore, a temporal autoregressive module is integrated into LaVieID to refine denoised latent tokens before video decoding. This module divides latent tokens temporally into chunks, exploiting their long-range temporal dependencies to predict biases for rectifying tokens, thereby significantly enhancing inter-frame identity consistency. Consequently, LaVieID can generate high-fidelity personalized videos and achieve state-of-the-art performance. Our code and models are available at https://github.com/ssugarwh/LaVieID.

视频生成扩散模型身份保持自回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。