任意视觉参考生成高保真身份一致视频,支持多格式输入与精准控制。
AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual References

- 统一多种输入格式的通用身份表征架构
- 通过差异提示实现属性级精确控制,身份保真度高
- 基于人类偏好对比训练,适合创意视频生成场景
身份保持视频生成为创作表达提供了强大工具,使用户能定制包含喜爱角色的视频。然而,现有方法通常针对单一身份参考设计和优化,限制了创作灵活性,并因依赖单一源导致模型难以在新情境中忠实复现身份。为此,我们提出AnyID,一种超保真身份保持视频生成框架,包含两项核心贡献:第一,引入可扩展的全参考架构,将异构身份输入(如人脸、肖像、视频)统一为连贯表征;第二,提出主参考生成范式,以一个参考作为标准锚点,通过新颖的差异提示实现属性级精确控制。我们在大规模精心构建的数据集上进行训练,确保鲁棒性与高保真度,随后使用强化学习进行微调,利用人类评估构建的偏好数据集,标注者基于身份保真度与提示可控性对视频进行成对比较。大量实验验证,AnyID在不同任务设置下均实现了超高的身份保真度和优越的属性级可控性。
原文摘要 · Abstract (English)
Identity-preserving video generation offers powerful tools for creative expression, allowing users to customize videos featuring their beloved characters. However, prevailing methods are typically designed and optimized for a single identity reference. This underlying assumption restricts creative flexibility by inadequately accommodating diverse real-world input formats. Relying on a single source also constitutes an ill-posed scenario, causing an inherently ambiguous setting that makes it difficult for the model to faithfully reproduce an identity across novel contexts. To address these issues, we present AnyID, an ultra-fidelity identity-preservation video generation framework that features two core contributions. First, we introduce a scalable omni-referenced architecture that effectively unifies heterogeneous identity inputs (e.g., faces, portraits, and videos) into a cohesive representation. Second, we propose a primary-referenced generation paradigm, which designates one reference as a canonical anchor and uses a novel differential prompt to enable precise, attribute-level controllability. We conduct training on a large-scale, meticulously curated dataset to ensure robustness and high fidelity, and then perform a final fine-tuning stage using reinforcement learning. This process leverages a preference dataset constructed from human evaluations, where annotators performed pairwise comparisons of videos based on two key criteria: identity fidelity and prompt controllability. Extensive evaluations validate that AnyID achieves ultra-high identity fidelity as well as superior attribute-level controllability across different task settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。