让扩散模型在标签模糊时仍能生成高质量图像
Learning Robust Diffusion Models from Imprecise Supervision
- 从似然最大化出发,拆解训练目标为生成与分类两部分
- 在图像生成、弱监督等场景下均显著提升生成质量
- 适合处理带噪声或不完整标签的数据集,提升模型鲁棒性
条件扩散模型在生成任务中表现卓越,但其训练依赖大规模数据集,而这些数据常包含不精确的条件输入。此类标注噪声、模糊或缺失会引发条件错配,降低生成质量。为此,我们提出DMIS,首个系统性研究扩散模型在不精确监督下训练的统一框架。该框架基于似然最大化,将目标分解为生成与分类两部分:生成部分建模不精确标签分布,分类部分利用扩散分类器推断类别后验概率,并通过优化时间步采样策略提升效率。在多种不精确监督形式(图像生成、弱监督学习、噪声数据压缩)上的实验表明,DMIS始终生成高质量且类别区分性强的样本。
原文摘要 · Abstract (English)
Conditional diffusion models have achieved remarkable success in various generative tasks recently, but their training typically relies on large-scale datasets that inevitably contain imprecise information in conditional inputs. Such supervision, often stemming from noisy, ambiguous, or incomplete labels, will cause condition mismatch and degrade generation quality. To address this challenge, we propose DMIS, a unified framework for training robust Diffusion Models from Imprecise Supervision, which is the first systematic study within diffusion models. Our framework is derived from likelihood maximization and decomposes the objective into generative and classification components: the generative component models imprecise-label distributions, while the classification component leverages a diffusion classifier to infer class-posterior probabilities, with its efficiency further improved by an optimized timestep sampling strategy. Extensive experiments on diverse forms of imprecise supervision, covering tasks of image generation, weakly supervised learning, and noisy dataset condensation demonstrate that DMIS consistently produces high-quality and class-discriminative samples.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。