arXiv:2510.20512cs.CV2025-10中稿 · CVPR被引 2

让单步生成模型也能个性定制,效果稳定且高效。

Adversarial Concept Distillation for One-Step Diffusion Personalization

  • 用多步模型当老师,单步模型当学生,通过对抗训练学习真实图像分布。
  • 在保持单步生成速度的前提下,实现高质量个性化,错误率显著降低。
  • 适合需要快速定制图像生成的AI艺术家、设计师等应用者。

近期文本到图像扩散模型的加速进展使得高保真合成可在单次去噪步骤内完成。然而,对这类快速单步模型进行个性化仍具挑战,现有方法普遍无法产生可接受结果,凸显了新方法的必要性。为此,我们提出一种名为单步个性化对抗蒸馏(OPAD)的框架,结合教师-学生蒸馏与对抗监督。多步扩散模型作为教师,单步学生模型与其联合训练。学生通过保持与教师一致性的对齐损失,以及使其输出逼近真实图像分布的对抗损失进行学习。此外,我们发现学生高效的生成能力与对抗增强的表征可为教师模型提供有价值反馈,形成协同学习阶段。大量实验表明,OPAD是首个能为单步扩散模型提供可靠、高质量个性化的方案;相比之下,先前方法大多失败并出现严重异常,而OPAD保持了单步生成效率。

原文摘要 · Abstract (English)

Recent progress in accelerating text-to-image diffusion models enables high-fidelity synthesis within a single denoising step. However, customizing the fast one-step models remains challenging, as existing methods consistently fail to produce acceptable results, underscoring the need for new methodologies to personalize one-step models. Therefore, we propose One-step Personalized Adversarial Distillation (OPAD), a framework that combines teacher-student distillation with adversarial supervision. A multi-step diffusion model serves as the teacher, while a one-step student model is jointly trained with it. The student learns from alignment losses that preserve consistency with the teacher and from adversarial losses that align its output with real image distributions. Beyond one-step personalization, we further observe that the student's efficient generation and adversarially enriched representations provide valuable feedback to improve the teacher model, forming a collaborative learning stage. Extensive experiments demonstrate that OPAD is the first approach to deliver reliable, high-quality personalization for one-step diffusion models; in contrast, prior methods largely fail and produce severe failure cases, while OPAD preserves single-step efficiency.

扩散模型个性化生成对抗训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。