arXiv:2511.08272cs.CV2025-11被引 1

提出可自适应融合机制的无监督图像融合方法

MAUGIF: Mechanism-Aware Unsupervised General Image Fusion via Dual Cross-Image Autoencoders

  • 基于双跨图像自编码器,区分加性与乘性融合机制
  • 通过双解码器有选择地注入模态特异性特征
  • 适用于多类图像融合任务,兼顾性能与可解释性

图像融合旨在整合多源图像的结构与互补信息。然而,现有方法要么高度依赖特定任务,要么采用统一策略的通用框架,忽略了不同任务间融合机制的差异。为此,我们提出一种机制感知的无监督通用图像融合方法(MAUGIF),基于双跨图像自编码器。首先,根据融合任务的本质机制,将融合分为加性和乘性两类。随后,双编码器将源图像映射到共享潜在空间,保留共有内容并分离模态特异性细节。解码阶段,双解码器作为特征注入器,有选择地将各模态的独特特征重新融入共享内容以实现重建。在融合过程中,模态特异性特征被注入源图像,生成融合图像,整合双模态信息。解码器架构依据融合机制动态调整,提升性能与可解释性。在多种融合任务上进行了广泛实验,验证了方法的有效性与泛化能力。代码已公开于 https://anonymous.4open.science/r/MAUGIF。

原文摘要 · Abstract (English)

Image fusion aims to integrate structural and complementary information from multi-source images. However, existing fusion methods are often either highly task-specific, or general frameworks that apply uniform strategies across diverse tasks, ignoring their distinct fusion mechanisms. To address this issue, we propose a mechanism-aware unsupervised general image fusion (MAUGIF) method based on dual cross-image autoencoders. Initially, we introduce a classification of additive and multiplicative fusion according to the inherent mechanisms of different fusion tasks. Then, dual encoders map source images into a shared latent space, capturing common content while isolating modality-specific details. During the decoding phase, dual decoders act as feature injectors, selectively reintegrating the unique characteristics of each modality into the shared content for reconstruction. The modality-specific features are injected into the source image in the fusion process, generating the fused image that integrates information from both modalities. The architecture of decoders varies according to their fusion mechanisms, enhancing both performance and interpretability. Extensive experiments are conducted on diverse fusion tasks to validate the effectiveness and generalization ability of our method. The code is available at https://anonymous.4open.science/r/MAUGIF.

图像融合自编码器无监督学习多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。