arXiv:2604.26348cs.CVcs.AI2026-04

用无参考质量评估引导扩散模型,提升图像感知质量而不失生成多样性。

ACPO: Anchor-Constrained Perceptual Optimization for Diffusion Models with No-Reference Quality Guidance

论文配图:ACPO: Anchor-Constrained Perceptual Optimization for Diffusion Models with No-Reference Quality Guidance
图 1 · 摘自论文原文
  • 引入无参考图像质量评估作为感知引导信号
  • 通过锚点正则化稳定训练,避免分布漂移
  • 适合追求真实感与视觉美感的图像生成应用

扩散模型在图像生成中取得显著成功,但其训练主要依赖全参考目标,强制像素级匹配真实图像。此类监督虽能保证保真度,却难以提升主观视觉质量与文本-图像语义一致性。本文研究如何将无参考感知质量融入扩散模型训练。核心挑战在于,直接优化无参考图像质量评估(NR-IQA)信号会与原始扩散目标产生不匹配,导致训练不稳定和微调时分布漂移。为此,我们提出锚点约束优化框架:利用学习得到的NR-IQA模型作为感知引导信号,同时引入基于锚点的正则化,确保噪声预测与基础扩散模型保持一致。该设计有效平衡感知质量提升与生成保真度,实现可控的感知优化,且不破坏原有生成行为。大量实验表明,本方法持续提升感知质量,同时保持生成多样性和训练稳定性,验证了锚点约束感知优化在扩散模型中的有效性。

原文摘要 · Abstract (English)

Diffusion models have achieved remarkable success in image generation, yet their training is predominantly driven by full-reference objectives that enforce pixel-wise similarity to ground-truth images.Such supervision, while effective for fidelity, may insufficient in terms of subjective visual perception quality and text-image semantic consistency. In this work, we investigate the problem of incorporating no-reference perceptual quality into diffusion training. A key challenge is that directly optimizing perceptual signals, such as those provided by no-reference image quality assessment (NR-IQA) models, introduces a mismatch with the original diffusion objective, leading to training instability and distributional drift during fine-tuning. To address this issue, we propose an anchor-constrained optimization framework that enables stable perceptual adaptation. Specifically, we leverage a learned NR-IQA model as a perceptual guidance signal, while introducing an anchor-based regularization that enforces consistency with the base diffusion model in terms of noise prediction. This design effectively balances perceptual quality improvement and generative fidelity, allowing controlled adaptation toward perceptually favorable outputs without compromising the original generative behavior. Extensive experiments demonstrate that our method consistently enhances perceptual quality while preserving generation diversity and training stability, highlighting the effectiveness of anchor-constrained perceptual optimization for diffusion models.

扩散模型感知优化无参考评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。