通过进化学习提升红外与可见光图像融合质量与任务性能。
DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusion

- 用进化算法动态优化多任务损失权重,实现双目标协同优化。
- 在三个基准上平均提升9.32%视觉质量,同时增强后续高阶任务表现。
- 适合需要高质量图像融合的智能感知、安防监控等场景。
红外与可见光图像融合通过整合不同波段信息,提升图像质量,发挥各自优势并弥补不足。现有方法通常将融合与后续高阶任务分离处理,导致融合图像对任务性能提升有限,且缺乏反馈优化融合过程。为此,我们提出判别式跨维度进化学习框架DCEvo,同时提升视觉质量和感知准确性。利用进化学习的强搜索能力,将双任务优化建模为多目标问题,通过进化算法(EA)动态调节损失函数权重。受视觉神经科学启发,在编码器和解码器中引入判别增强模块(DE),有效学习多模态互补特征。此外,跨维度嵌入(CDE)块促进高维任务特征与低维融合特征间的相互增强,实现高效统一的特征融合。在三个基准上的实验表明,本方法显著优于现有先进方法,平均视觉质量提升9.32%,同时提升后续高阶任务性能。代码已开源:https://github.com/Beate-Suy-Zhang/DCEvo。
原文摘要 · Abstract (English)
Infrared and visible image fusion integrates information from distinct spectral bands to enhance image quality by leveraging the strengths and mitigating the limitations of each modality. Existing approaches typically treat image fusion and subsequent high-level tasks as separate processes, resulting in fused images that offer only marginal gains in task performance and fail to provide constructive feedback for optimizing the fusion process. To overcome these limitations, we propose a Discriminative Cross-Dimension Evolutionary Learning Framework, termed DCEvo, which simultaneously enhances visual quality and perception accuracy. Leveraging the robust search capabilities of Evolutionary Learning, our approach formulates the optimization of dual tasks as a multi-objective problem by employing an Evolutionary Algorithm (EA) to dynamically balance loss function parameters. Inspired by visual neuroscience, we integrate a Discriminative Enhancer (DE) within both the encoder and decoder, enabling the effective learning of complementary features from different modalities. Additionally, our Cross-Dimensional Embedding (CDE) block facilitates mutual enhancement between high-dimensional task features and low-dimensional fusion features, ensuring a cohesive and efficient feature integration process. Experimental results on three benchmarks demonstrate that our method significantly outperforms state-of-the-art approaches, achieving an average improvement of 9.32% in visual quality while also enhancing subsequent high-level tasks. The code is available at https://github.com/Beate-Suy-Zhang/DCEvo.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。