提出轻量级评估框架,让红外可见光融合效果评测快1000倍且更符合人眼判断。
EvaNet: Towards More Efficient and Consistent Infrared and Visible Image Fusion Assessment

- 拆分融合图像为红外与可见光成分,分别评估信息保留度。
- 相比传统方法快1000倍,且在多个基准上一致性显著提升。
- 首次引入人眼感知一致性评估,适合研究图像融合的学者。
评估在图像融合研究中至关重要,但现有指标多直接借用其他视觉任务,未经适配。这些传统指标依赖复杂图像变换,不仅难以反映融合结果的真实质量,还计算开销大。为此,我们提出专用于图像融合的统一评估框架。核心是一个轻量网络,采用分治策略高效逼近常用指标。不同于直接比对融合图与源图相似性,我们先将融合结果分解为红外与可见光成分,再用评估模型衡量各成分的信息保留程度,有效解耦评估过程。训练时引入对比学习,并结合大语言模型提供的感知场景评估作为监督信号。最后,提出首个一致性评估框架,通过无参考分数和下游任务表现双重客观参考,衡量融合指标与人眼感知的一致性。大量实验表明,该学习型评估范式在标准融合基准上兼具卓越效率(最高快1000倍)与更高一致性。代码将公开于https://github.com/AWCXV/EvaNet。
原文摘要 · Abstract (English)
Evaluation is essential in image fusion research, yet most existing metrics are directly borrowed from other vision tasks without proper adaptation. These traditional metrics, often based on complex image transformations, not only fail to capture the true quality of the fusion results but also are computationally demanding. To address these issues, we propose a unified evaluation framework specifically tailored for image fusion. At its core is a lightweight network designed efficiently to approximate widely used metrics, following a divide-and-conquer strategy. Unlike conventional approaches that directly assess similarity between fused and source images, we first decompose the fusion result into infrared and visible components. The evaluation model is then used to measure the degree of information preservation in these separated components, effectively disentangling the fusion evaluation process. During training, we incorporate a contrastive learning strategy and inform our evaluation model by perceptual scene assessment provided by a large language model. Last, we propose the first consistency evaluation framework, which measures the alignment between image fusion metrics and human visual perception, using both independent no-reference scores and downstream tasks performance as objective references. Extensive experiments show that our learning-based evaluation paradigm delivers both superior efficiency (up to 1,000 times faster) and greater consistency across a range of standard image fusion benchmarks. Our code will be publicly available at https://github.com/AWCXV/EvaNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。