通过分析扩散过程中的异常分数动态,实时纠正生成缺陷。
Temporal Score Analysis for Understanding and Correcting Diffusion Artifacts
- 识别扩散过程三阶段,发现缺陷源于变异期的异常分数变化
- 提出ASCED方法,实时检测并修正异常区域的噪声生成
- 无需额外训练,可无缝集成于现有扩散流程,适用多领域
视觉伪影仍是扩散模型中的顽固挑战,即使在大规模数据集上训练后依然存在。现有方法多依赖有监督检测器,却无法解释伪影产生的原因。我们分析发现扩散生成过程包含三个阶段:轮廓构建、变异和精炼。伪影通常出现在变异阶段,某些区域表现出异常的分数动态,导致生成过程突变。这种时间特性说明仅关注最终输出的空间不确定性难以有效定位伪影。基于此,我们提出ASCED(异常分数修正以增强扩散生成),通过监测扩散过程中的异常分数动态来检测伪影,并采用轨迹感知的实时噪声修正策略。与大多数在生成后进行去噪修正的方法不同,我们的策略可无缝嵌入原有扩散流程。大量实验表明,该方法在多种场景下有效减少伪影,性能达到或超越现有有监督方法,且无需额外训练。
原文摘要 · Abstract (English)
Visual artifacts remain a persistent challenge in diffusion models, even with training on massive datasets. Current solutions primarily rely on supervised detectors, yet lack understanding of why these artifacts occur in the first place. In our analysis, we identify three distinct phases in the diffusion generative process: Profiling, Mutation, and Refinement. Artifacts typically emerge during the Mutation phase, where certain regions exhibit anomalous score dynamics over time, causing abrupt disruptions in the normal evolution pattern. This temporal nature explains why existing methods focusing only on spatial uncertainty of the final output fail at effective artifact localization. Based on these insights, we propose ASCED (Abnormal Score Correction for Enhancing Diffusion), that detects artifacts by monitoring abnormal score dynamics during the diffusion process, with a trajectory-aware on-the-fly mitigation strategy that appropriate generation of noise in the detected areas. Unlike most existing methods that apply post hoc corrections, \eg, by applying a noising-denoising scheme after generation, our mitigation strategy operates seamlessly within the existing diffusion process. Extensive experiments demonstrate that our proposed approach effectively reduces artifacts across diverse domains, matching or surpassing existing supervised methods without additional training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。