用动态判别器池实现单步高保真生成,速度与质量兼得。
NitroFusion: High-Fidelity Single-Step Diffusion through Dynamic Adversarial Training
- 构建多组专用判别器,分阶段评估生成质量。
- 在多个数据集上超越现有单步方法,细节与整体一致性更优。
- 支持1-4步灵活调整,适合需要速度与质量平衡的场景。
我们提出NitroFusion,一种基于动态对抗训练的单步扩散生成新范式。传统单步方法虽速度快,但质量常逊于多步方法。受艺术评论家分工协作启发,该框架维护一个由多个专业化判别器组成的动态池,各组在不同噪声水平下专注评估构图、色彩、技法等特定维度,提供多角度反馈以提升生成质量。其核心包括:(i) 动态判别器池与分组设计,增强质量引导能力;(ii) 战略性刷新机制,防止判别器过拟合;(iii) 全局-局部判别头结合无条件/有条件训练,实现多尺度质量评估与均衡生成。此外,该框架支持自底向上的精炼策略,同一模型可动态选择1至4步去噪,直接实现质量与速度的权衡。大量实验表明,NitroFusion在多项指标上显著优于现有单步方法,尤其在保留细节与维持全局一致性方面表现突出。
原文摘要 · Abstract (English)
We introduce NitroFusion, a fundamentally different approach to single-step diffusion that achieves high-quality generation through a dynamic adversarial framework. While one-step methods offer dramatic speed advantages, they typically suffer from quality degradation compared to their multi-step counterparts. Just as a panel of art critics provides comprehensive feedback by specializing in different aspects like composition, color, and technique, our approach maintains a large pool of specialized discriminator heads that collectively guide the generation process. Each discriminator group develops expertise in specific quality aspects at different noise levels, providing diverse feedback that enables high-fidelity one-step generation. Our framework combines: (i) a dynamic discriminator pool with specialized discriminator groups to improve generation quality, (ii) strategic refresh mechanisms to prevent discriminator overfitting, and (iii) global-local discriminator heads for multi-scale quality assessment, and unconditional/conditional training for balanced generation. Additionally, our framework uniquely supports flexible deployment through bottom-up refinement, allowing users to dynamically choose between 1-4 denoising steps with the same model for direct quality-speed trade-offs. Through comprehensive experiments, we demonstrate that NitroFusion significantly outperforms existing single-step methods across multiple evaluation metrics, particularly excelling in preserving fine details and global consistency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。