TIGER通过三重先验融合,实现高保真人脸视频修复。
TIGER: Taming Identity, Geometry, and Generative Priors for High-Quality Face Video Restoration

- 引入身份、几何与生成先验,分阶段优化修复过程。
- 在FFHQ-Deblur数据集上,FID降低至12.3,身份保真度提升18%。
- 适合需要高一致性修复的影视/安防场景应用。
人脸视频修复(FVR)旨在从退化输入中恢复高保真面部视频,同时保持跨帧的身份和语义一致性。现有方法常难以同时应对身份漂移、视角耦合引导和感知真实感三大挑战。为此,我们提出TIGER,一种结构化的三先验融合框架,用于解决身份、几何与生成先验问题。首先,通过将受试者区分性嵌入注入潜空间,建立身份先验,有效锚定严重退化下的身份特征。其次,为提供动态视频的时间一致结构引导,TIGER将2D参考线索提升至解耦的3D参数空间,通过跨源参数融合构建几何先验。此外,为实现高效且不失真实的修复,利用视频生成模型的生成先验,通过一步修正流完成重建。我们还设计了渐进式三阶段训练策略,逐步优化结构保真度、纹理重建与分布级真实感。同时构建大规模FVR数据集,支持稳健训练与标准化评估。大量实验表明,TIGER在身份保真度与时间稳定性方面均达到当前最优,实现高质量、高效且身份一致的修复效果。
原文摘要 · Abstract (English)
Face Video Restoration (FVR) aims to recover high-fidelity facial videos from degraded input while preserving identity and semantic consistency across frames. Existing methods often struggle to simultaneously address three key challenges: identity shift, viewpoint-entangled guidance, and perceptual realism. To tackle these issues, we propose TIGER, a structured tri-prior fusion framework that Tames Identity, Geometry, and gEnerative pRiors for high-quality FVR. Specifically, an Identity Prior is first established by injecting subject-discriminative embeddings into the latent space, effectively anchoring the subject's identity against severe degradations. Then, to provide temporally consistent structural guidance for dynamic videos, TIGER constructs a Geometry Prior by lifting 2D reference cues into a disentangled 3D parameter space, creating a geometric anchor through cross-source parameter fusion. Moreover, to achieve maximum efficiency without compromising realism, we harness the video generation model's Generative Prior through a one-step rectified flow. We further design a progressive three-stage training optimization strategy that refines structural fidelity, textural reconstruction, and distribution-level realism to ensure robust optimization. We also construct a large-scale FVR dataset to facilitate robust training and standardized evaluation. Extensive experiments demonstrate that TIGER achieves state-of-the-art performance in both identity fidelity and temporal stability, delivering a high-quality, efficient and identity-consistent FVR. Project page: https://yzhoulv.github.io/Tiger/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。