arXiv:2607.22830cs.CV2026-07中稿 · SIGGRAPH

让视频人物保持原样,同时自由更换风格和光照。

ID-V2V: Identity-Preserving Video Restylization

论文配图:ID-V2V: Identity-Preserving Video Restylization
图 1 · 摘自论文原文
  • 将身份保持与风格迁移解耦,以光影变化约束人脸特征。
  • 仅需单个视频即可生成训练数据,无需成对标注。
  • 精准保留表情、眼神和口型同步,适合影视创作应用。

在视觉叙事中,人类表演是创意意图和叙事意义的核心。然而,生成模型在灵活修改视觉风格的同时保持人物身份和表演细节仍具挑战。本文提出身份保持的视频重风格化任务:在源视频中传播由编辑关键帧指定的场景、光照和风格变化,同时保留面部相似性及表演特征(如表情、眼神方向、唇同步)。核心难点在于缺乏成对训练数据,真实世界中极少存在身份一致的风格化视频对。为此,我们提出将源视频引导的身份保持与编辑驱动的视频生成解耦。关键洞察是面部外观与表情应保持不变,仅允许光照变化。因此,将身份保持建模为视频重照明问题,而视觉编辑传播则通过编辑关键帧引导的可控视频生成实现。基于此,提出ID-V2V框架,融合互补控制信号:重照明面部区域和法向图严格约束面部相似性与表演一致性,编辑关键帧与深度序列实现灵活且时序连贯的生成。该设计可仅用单个视频构建训练对,避免对稀缺成对数据的依赖。大量实验表明,ID-V2V在面部相似性与细粒度表演保持方面显著优于现有方法,支持单人与多人场景,且生成质量高,具备成为面向真实内容生产的以人为本工具的潜力。代码已开源:https://github.com/Eyeline-Labs/ID-V2V。

原文摘要 · Abstract (English)

In visual storytelling, human performances are central to creative intent and narrative meaning. However, preserving human identity and performance while enabling flexible visual edits remains challenging for generative video models. We formalize this challenge as identity-preserving video restylization, which propagates scene, lighting, and style changes specified by an edited keyframe across a source video, while preserving facial likeness and performance, including expressions, eye gaze, and lip synchronization. A key obstacle is the absence of paired training data, as identity-preserving restylized video pairs are rare in real-world settings. To address this, we propose a decoupling of source-grounded identity preservation and edit-driven video synthesis. Our key insight is that facial appearance and expression should remain invariant, with illumination being the primary permissible variation. We therefore cast identity preservation as a video relighting problem, while modeling visual edit propagation as controlled video synthesis guided by the edited keyframe. Building on this formulation, we introduce ID-V2V, a video-to-video generative framework integrating complementary control signals: relit facial regions and facial normal maps tightly constrain facial likeness and performance, while edited keyframes and depth sequences enable flexible and temporally coherent generation. This design enables constructing training pairs from a single video, eliminating the need for scarce paired data. Extensive experiments demonstrate that ID-V2V significantly outperforms existing methods in preserving facial likeness and fine-grained facial performance, supports both single- and multi-subject scenarios, and delivers high visual quality, highlighting its potential as a human-centric tool for real-world content production. The code is available at: https://github.com/Eyeline-Labs/ID-V2V.

视频重风格化身份保持生成模型人脸保真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。