arXiv:2604.08922cs.CV2026-04中稿 · CVPR被引 1

提出一种自适应退化感知的扩散模型,高效融合复杂退化图像。

Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios

论文配图:Degradation-Robust Fusion: An Efficient Degradation-Aware Diffusion Framework for Multimodal Image Fusion in Arbitrary Degradation Scenarios
图 1 · 摘自论文原文
  • 直接回归融合图像实现隐式去噪,无需显式预测噪声。
  • 联合建模退化与融合约束,采样时保持高重建精度。
  • 适用于任意退化场景,尤其适合多源图像融合任务。

真实世界图像融合常面临噪声、模糊、低分辨率等复杂退化问题,限制了现有方法的性能与实用性。端到端神经网络方法设计简单、推理高效,但黑箱特性导致可解释性差。扩散模型通过强大生成先验和结构化推理过程在一定程度上缓解此问题,但其训练目标为单一域目标分布,而图像融合缺乏自然融合数据,依赖从多源中建模互补信息,难以直接应用。为此,本文提出一种高效的退化感知扩散框架,用于任意退化场景下的多模态图像融合。具体地,不同于传统扩散模型显式预测噪声,本方法通过直接回归融合图像实现隐式去噪,可在有限步数内灵活适应多种融合任务。此外,设计联合观测模型校正机制,在采样过程中同时施加退化与融合约束,确保高重建精度。在多种融合任务与退化配置上的实验表明,该方法在复杂退化场景下具有显著优势。

原文摘要 · Abstract (English)

Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks, limiting the performance and practicality of existing methods. End to end neural network based approaches are generally simple to design and highly efficient in inference, but their black-box nature leads to limited interpretability. Diffusion based methods alleviate this to some extent by providing powerful generative priors and a more structured inference process. However, they are trained to learn a single domain target distribution, whereas fusion lacks natural fused data and relies on modeling complementary information from multiple sources, making diffusion hard to apply directly in practice. To address these challenges, this paper proposes an efficient degradation aware diffusion framework for image fusion under arbitrary degradation scenarios. Specifically, instead of explicitly predicting noise as in conventional diffusion models, our method performs implicit denoising by directly regressing the fused image, enabling flexible adaptation to diverse fusion tasks under complex degradations with limited steps. Moreover, we design a joint observation model correction mechanism that simultaneously imposes degradation and fusion constraints during sampling to ensure high reconstruction accuracy. Experiments on diverse fusion tasks and degradation configurations demonstrate the superiority of the proposed method under complex degradation scenarios.

图像融合扩散模型退化感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。