arXiv:2501.09503cs.CV2025-01被引 17

统一处理单/多主体个性化图像生成,保持细节真实度。

AnyStory: Towards Unified Single and Multiple Subject Personalization in Text-to-Image Generation

  • 用编码-路由框架分离主体特征与位置预测
  • 支持单或多主体生成,保留高保真细节
  • 适合需要精准人物定制的图像生成场景

近期大规模生成模型展现出卓越的文本到图像生成能力,但在生成特定主体的高保真个性化图像方面仍面临挑战,尤其在多主体情况下。本文提出 AnyStory,一种统一的个性化主体生成方法,不仅实现单主体的高保真个性化,也能有效处理多主体情况,且不牺牲主体保真度。具体而言,AnyStory采用“编码-路由”范式:编码阶段结合 ReferenceNet 和 CLIP 视觉编码器,实现主体特征的高保真编码;路由阶段使用解耦的实例感知主体路由模块,准确感知并预测潜在主体在隐空间中的位置,引导主体条件注入。实验表明,该方法在保留主体细节、对齐文本描述和多主体个性化方面表现优异。

原文摘要 · Abstract (English)

Recently, large-scale generative models have demonstrated outstanding text-to-image generation capabilities. However, generating high-fidelity personalized images with specific subjects still presents challenges, especially in cases involving multiple subjects. In this paper, we propose AnyStory, a unified approach for personalized subject generation. AnyStory not only achieves high-fidelity personalization for single subjects, but also for multiple subjects, without sacrificing subject fidelity. Specifically, AnyStory models the subject personalization problem in an "encode-then-route" manner. In the encoding step, AnyStory utilizes a universal and powerful image encoder, i.e., ReferenceNet, in conjunction with CLIP vision encoder to achieve high-fidelity encoding of subject features. In the routing step, AnyStory utilizes a decoupled instance-aware subject router to accurately perceive and predict the potential location of the corresponding subject in the latent space, and guide the injection of subject conditions. Detailed experimental results demonstrate the excellent performance of our method in retaining subject details, aligning text descriptions, and personalizing for multiple subjects. The project page is at https://aigcdesigngroup.github.io/AnyStory/ .

个性化生成多主体文本生成图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。