arXiv:2504.01689cs.CV2025-04NeurIPS被引 8

提出首个能适应不同退化条件的训练式扩散模型,兼顾精度与灵活性。

InvFusion: Bridging Supervised and Zero-shot Diffusion for Inverse Problems

  • 将退化算子直接嵌入扩散去噪器,实现训练式退化感知采样
  • 在FFHQ和ImageNet上达到当前最优性能,超越零样本与盲训练方法
  • 可推广为均方误差最小化预测器和后验主成分估计器,适用性广

扩散模型在逆问题求解中表现出色,提供高质量的后验采样。然而,存在根本性权衡:零样本方法可应对任意线性退化,但依赖近似导致精度下降;训练式方法虽能正确建模后验分布,却无法在测试时适应新退化。本文提出InvFusion,首个训练式退化感知后验采样器。其通过新颖架构将退化算子直接融入扩散去噪器,融合监督方法的高性能与零样本方法的灵活性。在FFHQ和ImageNet数据集上的实验表明,该方法性能达当前最优。此外,其架构还可作为通用最小均方误差预测器及神经后验主成分估计器,具备广泛适用性。

原文摘要 · Abstract (English)

Diffusion Models have demonstrated remarkable capabilities in handling inverse problems, offering high-quality posterior-sampling-based solutions. Despite significant advances, a fundamental trade-off persists regarding the way the conditioned synthesis is employed: Zero-shot approaches can accommodate any linear degradation but rely on approximations that reduce accuracy. In contrast, training-based methods model the posterior correctly, but cannot adapt to the degradation at test-time. Here we introduce InvFusion, the first training-based degradation-aware posterior sampler. InvFusion combines the best of both worlds -- the strong performance of supervised approaches and the flexibility of zero-shot methods. This is achieved through a novel architectural design that seamlessly integrates the degradation operator directly into the diffusion denoiser. We compare InvFusion against existing general-purpose posterior samplers, both degradation-aware zero-shot techniques and blind training-based methods. Experiments on the FFHQ and ImageNet datasets demonstrate state-of-the-art performance. Beyond posterior sampling, we further demonstrate the applicability of our architecture, operating as a general Minimum Mean Square Error predictor, and as a Neural Posterior Principal Component estimator.

扩散模型逆问题图像恢复后验采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。