小样本生成模型适配中保留源域身份信息,提升图像质量
Few-Shot Generative Model Adaption via Identity Injection and Preservation
- 通过身份注入与一致性对齐,将源域特征融入目标域潜空间
- 在少于10个样本下,5项指标均优于现有方法
- 适合需要跨域保持身份一致性的图像生成任务
在少量数据下训练生成模型易引发模式崩溃。现有方法在仅用少于10个样本进行小样本生成模型适配时,常因遗忘源域身份知识而导致目标域生成图像质量下降。为此,本文提出身份注入与保持(I²P)方法,通过身份注入模块将源域身份知识融入目标域潜空间,并设计身份替换模块(含风格-内容解耦器与重建调制器),结合特征一致性约束强化身份保持。定量与定性实验表明,该方法在多个公开数据集上5项指标均显著优于当前最优方法。
原文摘要 · Abstract (English)
Training generative models with limited data presents severe challenges of mode collapse. A common approach is to adapt a large pretrained generative model upon a target domain with very few samples (fewer than 10), known as few-shot generative model adaptation. However, existing methods often suffer from forgetting source domain identity knowledge during adaptation, which degrades the quality of generated images in the target domain. To address this, we propose Identity Injection and Preservation (I$^2$P), which leverages identity injection and consistency alignment to preserve the source identity knowledge. Specifically, we first introduce an identity injection module that integrates source domain identity knowledge into the target domain's latent space, ensuring the generated images retain key identity knowledge of the source domain. Second, we design an identity substitution module, which includes a style-content decoupler and a reconstruction modulator, to further enhance source domain identity preservation. We enforce identity consistency constraints by aligning features from identity substitution, thereby preserving identity knowledge. Both quantitative and qualitative experiments show that our method achieves substantial improvements over state-of-the-art methods on multiple public datasets and 5 metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。