arXiv:2503.06505cs.CVcs.AI2025-03ICCV被引 16

无需微调,一键生成多个人物形象并自由调整面部特征。

DynamicID: Zero-Shot Multi-ID Image Personalization with Flexible Facial Editability

  • 用语义激活注意力机制,实现无须多身份样本的多角色生成。
  • 通过特征空间重配置,分离表情与身份信息,支持灵活面部编辑。
  • 适用于需要多角色个性化图像生成的创作者或设计师。

文本到图像生成的进展推动了从参考图像生成特定人物形象的个性化需求。尽管现有方法在身份保真度上表现良好,但通常仅限于单身份场景且面部可编辑性不足。我们提出 DynamicID,一种无需微调的框架,能以高保真度实现单身份和多身份个性化生成,并具备灵活的面部编辑能力。核心创新包括:1)语义激活注意力(SAA),通过查询级激活门控,在注入身份特征时最小化对基础模型的干扰,实现训练阶段无需多身份样本的多身份个性化;2)身份-运动重配置器(IMR),在特征空间中操作,有效解耦并重组面部运动与身份特征,支持灵活的面部编辑;3)任务解耦训练范式,降低数据依赖性,结合 VariFace-10k 数据集(包含10,000名独特个体,每人35张不同面部图像)。实验表明,DynamicID 在身份保真度、面部可编辑性和多身份生成能力上均优于现有最优方法。

原文摘要 · Abstract (English)

Recent advances in text-to-image generation have driven interest in generating personalized human images that depict specific identities from reference images. Although existing methods achieve high-fidelity identity preservation, they are generally limited to single-ID scenarios and offer insufficient facial editability. We present DynamicID, a tuning-free framework that inherently facilitates both single-ID and multi-ID personalized generation with high fidelity and flexible facial editability. Our key innovations include: 1) Semantic-Activated Attention (SAA), which employs query-level activation gating to minimize disruption to the base model when injecting ID features and achieve multi-ID personalization without requiring multi-ID samples during training. 2) Identity-Motion Reconfigurator (IMR), which applies feature-space manipulation to effectively disentangle and reconfigure facial motion and identity features, supporting flexible facial editing. 3) a task-decoupled training paradigm that reduces data dependency, together with VariFace-10k, a curated dataset of 10k unique individuals, each represented by 35 distinct facial images. Experimental results demonstrate that DynamicID outperforms state-of-the-art methods in identity fidelity, facial editability, and multi-ID personalization capability. Our code will be released at https://github.com/ByteCat-bot/DynamicID.

个性生成面部编辑多身份

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。