arXiv:2608.00674cs.CV2026-08

仅用几秒就让个性化图像生成更精准保留人物细节。

CopyCat: Improving Fine-Grained Subject Consistency in Subject-to-Image Models within Seconds

论文配图:CopyCat: Improving Fine-Grained Subject Consistency in Subject-to-Image Models within Seconds
图 1 · 摘自论文原文
  • 用单张代理图自重建,快速优化模型细节一致性。
  • 一次训练后可适配多种新主体,无需重复调优。
  • 轻量级改造现有模型,适合快速部署与应用。

近期的主体到图像生成模型在个性化图像生成方面取得显著进展,但仍难以保持细粒度的主体特异性细节。主要原因在于缺乏高质量的细粒度身份监督:真实配对数据收集成本高,而合成训练样本通常仅保留粗粒度外观,无法捕捉细微特征。本文提出 CopyCat,一种轻量级模型优化框架,可在数秒内提升细粒度主体一致性。该方法通过附加一个轻量级细粒度一致性 LoRA(FCLoRA),并使用单张代理图像作为条件与重构目标进行一次性优化,实现精确的自重建。此优化仅需一次执行,优化后的模型可直接应用于多样化的未见主体和提示词,无需额外主体特定训练。我们进一步重新审视双流扩散变换器中的主体到图像 LoRA 训练,发现仅调整视觉流即可稳定提升主体一致性。在 DreamBench 与 XVerseBench 上的大量实验表明,该方法在单主体与多主体设置下,均显著提升了代表性主体到图像模型的细粒度主体一致性。

原文摘要 · Abstract (English)

Recent subject-to-image models have achieved impressive progress in personalized image generation, yet they still struggle to preserve fine-grained subject-specific details. A major reason is the lack of high-quality fine-grained identity supervision: real paired data are expensive to collect, while synthesized training pairs often preserve only coarse subject appearance and fail to capture subtle subject-specific details. In this work, we propose CopyCat, a lightweight model-refinement framework that improves fine-grained subject consistency within only a few seconds. CopyCat performs a one-time refinement of a pretrained subject-to-image model by attaching a lightweight Fine-grained Consistency LoRA (FCLoRA) and optimizing it using a single proxy image, which is used as both the conditioning image and the reconstruction target. This exact self-reconstruction objective substantially simplifies the optimization task, enabling effective fine-grained refinement within only a few seconds. The refinement is performed only once; the resulting model can be directly applied to diverse unseen reference subjects and prompts without further subject-specific optimization. We further revisit subject-to-image LoRA training in double-stream diffusion transformers and find that adapting only the visual stream consistently improves subject consistency. Extensive experiments on DreamBench and XVerseBench demonstrate consistent improvements in fine-grained subject consistency across representative subject-to-image models under both single- and multi-subject settings.

图像生成主体一致LoRA轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。