arXiv:2509.16549cs.CV2025-09NeurIPS被引 15

用一步采样实现高效图像融合,速度更快质量不降。

Efficient Rectified Flow for Image Fusion

  • 基于修正流设计一步采样,无需额外训练。
  • 推理速度比现有方法快2倍以上,保持高质量融合结果。
  • 专为图像融合优化的VAE架构,适合实时应用需求。

图像融合是计算机视觉中的基础任务,旨在融合多模态图像的互补信息。近年来,扩散模型在该领域取得显著进展,但通常计算复杂且推理冗余,限制了实际应用。为此,本文提出RFfusion,一种基于修正流的一步扩散模型,通过拉直采样路径实现无需额外训练的一步采样,同时保持高质量融合效果。此外,设计了面向图像融合的任务专用变分自编码器(VAE),将融合操作嵌入潜在空间以降低计算开销。针对传统重建导向的VAE目标与融合需求之间的差异,提出两阶段训练策略,有效学习并整合多模态源图像的互补信息,从而在保留细粒度结构细节的同时大幅提升推理效率。大量实验表明,本方法在推理速度和融合质量上均优于当前最优方法。代码已公开于https://github.com/zirui0625/RFfusion。

原文摘要 · Abstract (English)

Image fusion is a fundamental and important task in computer vision, aiming to combine complementary information from different modalities to fuse images. In recent years, diffusion models have made significant developments in the field of image fusion. However, diffusion models often require complex computations and redundant inference time, which reduces the applicability of these methods. To address this issue, we propose RFfusion, an efficient one-step diffusion model for image fusion based on Rectified Flow. We incorporate Rectified Flow into the image fusion task to straighten the sampling path in the diffusion model, achieving one-step sampling without the need for additional training, while still maintaining high-quality fusion results. Furthermore, we propose a task-specific variational autoencoder (VAE) architecture tailored for image fusion, where the fusion operation is embedded within the latent space to further reduce computational complexity. To address the inherent discrepancy between conventional reconstruction-oriented VAE objectives and the requirements of image fusion, we introduce a two-stage training strategy. This approach facilitates the effective learning and integration of complementary information from multi-modal source images, thereby enabling the model to retain fine-grained structural details while significantly enhancing inference efficiency. Extensive experiments demonstrate that our method outperforms other state-of-the-art methods in terms of both inference speed and fusion quality. Code is available at https://github.com/zirui0625/RFfusion.

图像融合扩散模型高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。