arXiv:2501.10761cs.CV2025-01TPAMI被引 216

系统梳理红外可见光图像融合的深度学习方法与挑战

Infrared and Visible Image Fusion: From Data Compatibility to Task Adaption

  • 构建多维度框架分析融合策略、数据兼容性与任务适应性
  • 对比多种方法在配准、融合及高层任务中的性能表现
  • 适合关注跨模态视觉融合与未来方向的研究者

红外-可见光图像融合(IVIF)是计算机视觉中的关键任务,旨在将红外与可见光谱的独特信息整合为统一表征。自2018年进入深度学习时代以来,各类网络结构与损失函数不断涌现,显著提升了视觉表现。然而,数据兼容性、感知精度与计算效率等挑战仍存。当前缺乏对这一快速发展的领域的最新综述。本文填补此空白,全面覆盖从视觉增强到数据兼容性与任务适应性的各类学习型方法。提出多维分析框架,辅以核心思想对照表,并系统总结定量与定性性能比较,聚焦配准、融合及后续高层任务。此外,还探讨了潜在未来方向与开放问题。更多内容可访问我们的GitHub仓库:https://github.com/RollingPlain/IVIF_ZOO。

原文摘要 · Abstract (English)

Infrared-visible image fusion (IVIF) is a critical task in computer vision, aimed at integrating the unique features of both infrared and visible spectra into a unified representation. Since 2018, the field has entered the deep learning era, with an increasing variety of approaches introducing a range of networks and loss functions to enhance visual performance. However, challenges such as data compatibility, perception accuracy, and efficiency remain. Unfortunately, there is a lack of recent comprehensive surveys that address this rapidly expanding domain. This paper fills that gap by providing a thorough survey covering a broad range of topics. We introduce a multi-dimensional framework to elucidate common learning-based IVIF methods, from visual enhancement strategies to data compatibility and task adaptability. We also present a detailed analysis of these approaches, accompanied by a lookup table clarifying their core ideas. Furthermore, we summarize performance comparisons, both quantitatively and qualitatively, focusing on registration, fusion, and subsequent high-level tasks. Beyond technical analysis, we discuss potential future directions and open issues in this area. For further details, visit our GitHub repository: https://github.com/RollingPlain/IVIF_ZOO.

图像融合跨模态深度学习红外可见光

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。