arXiv:2503.12526cs.CV2025-03EMNLP被引 8

无需训练即可自由编辑人物形象,保持身份一致性。

EditID: Training-Free Editable ID Customization for Text-to-Image Generation

  • 拆分模型为图像生成与特征提取双分支,实现可编辑特征空间
  • 在IBench评测中显著提升编辑能力,兼顾高质量生成
  • 适合需要长提示和高保真定制人物的生成场景

我们提出EditID,一种基于DiT架构的免训练方法,实现文本到图像生成中高度可编辑的定制化身份。现有定制化身份模型多关注身份一致性,忽视编辑性,难以通过提示调整面部朝向、人物属性等。EditID将模型解耦为图像生成分支与角色特征分支,后者进一步分为特征提取、融合与整合模块。通过引入映射特征与偏移特征,并控制身份特征整合强度,实现跨网络深度的局部特征语义压缩,构建可编辑特征空间。该方法在保持身份一致性的前提下,成功生成高质量可编辑图像,在IBench评估框架中量化验证了其优越性能。EditID是首个在DiT架构上实现定制身份可编辑性的方案,满足长提示与高质量生成需求。

原文摘要 · Abstract (English)

We propose EditID, a training-free approach based on the DiT architecture, which achieves highly editable customized IDs for text to image generation. Existing text-to-image models for customized IDs typically focus more on ID consistency while neglecting editability. It is challenging to alter facial orientation, character attributes, and other features through prompts. EditID addresses this by deconstructing the text-to-image model for customized IDs into an image generation branch and a character feature branch. The character feature branch is further decoupled into three modules: feature extraction, feature fusion, and feature integration. By introducing a combination of mapping features and shift features, along with controlling the intensity of ID feature integration, EditID achieves semantic compression of local features across network depths, forming an editable feature space. This enables the successful generation of high-quality images with editable IDs while maintaining ID consistency, achieving excellent results in the IBench evaluation, which is an editability evaluation framework for the field of customized ID text-to-image generation that quantitatively demonstrates the superior performance of EditID. EditID is the first text-to-image solution to propose customizable ID editability on the DiT architecture, meeting the demands of long prompts and high quality image generation.

文本生成图像身份定制可编辑性DiT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。