arXiv:2505.02364cs.CV2025-05

用四元数域融合红外与可见光图像,提升低光照下图像质量。

Quaternion Infrared Visible Image Fusion

论文配图:Quaternion Infrared Visible Image Fusion
图 1 · 摘自论文原文
  • 在四元数域中统一处理多模态图像特征,保留颜色结构信息。
  • 在低可见度条件下实现更优的热目标与纹理细节融合效果。
  • 适合需要高精度跨模态图像融合的应用场景。

可见光图像在光照充足时提供丰富细节和色彩信息,而红外图像在能见度低或恶劣天气下可有效突出热目标。红外-可见光图像融合旨在整合两者互补信息,生成高质量融合图像。现有方法存在忽视可见光图像色彩结构信息、在低质量彩色可见光输入下性能下降等问题。为此,本文提出四元数红外-可见光图像融合(QIVIF)框架,在四元数域内完全完成融合。QIVIF设计了四元数低可见度特征学习模型,自适应提取不同退化条件下的热目标与细粒度纹理;提出四元数自适应非锐化掩膜方法,平衡光照条件增强高频特征;构建四元数分层贝叶斯融合模型,集成红外显著性与增强的可见光细节,生成高质量融合图像。在多个数据集上的大量实验表明,该方法在挑战性低可见度条件下优于现有先进方法。

原文摘要 · Abstract (English)

Visible images provide rich details and color information only under well-lighted conditions while infrared images effectively highlight thermal targets under challenging conditions such as low visibility and adverse weather. Infrared-visible image fusion aims to integrate complementary information from infrared and visible images to generate a high-quality fused image. Existing methods exhibit critical limitations such as neglecting color structure information in visible images and performance degradation when processing low-quality color-visible inputs. To address these issues, we propose a quaternion infrared-visible image fusion (QIVIF) framework to generate high-quality fused images completely in the quaternion domain. QIVIF proposes a quaternion low-visibility feature learning model to adaptively extract salient thermal targets and fine-grained texture details from input infrared and visible images respectively under diverse degraded conditions. QIVIF then develops a quaternion adaptive unsharp masking method to adaptively improve high-frequency feature enhancement with balanced illumination. QIVIF further proposes a quaternion hierarchical Bayesian fusion model to integrate infrared saliency and enhanced visible details to obtain high-quality fused images. Extensive experiments across diverse datasets demonstrate that our QIVIF surpasses state-of-the-art methods under challenging low-visibility conditions.

图像融合四元数红外可见光低可见度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。