用双曲空间解决红外与可见光图像对齐难题,提升融合质量。
Hyperbolic Cycle Alignment for Infrared-Visible Image Fusion
- 在双曲空间中构建前后向循环对齐框架,实现跨模态几何一致对齐。
- 在多个数据集上显著优于现有方法,峰值信噪比提升超过2.5dB。
- 适合需要高精度多模态图像融合的科研与工程场景。
图像融合通过整合多源互补信息,克服单模态成像系统的固有局限。精确的图像配准对有效多源数据融合至关重要。然而,现有基于欧几里得空间图像平移的配准方法难以有效处理跨模态错位问题,导致对齐和融合质量不佳。为克服此局限,我们探索在非欧几里得空间中进行图像对齐,提出首个基于双曲空间的图像配准方法——双曲循环对齐网络(Hy-CycleAlign)。该方法设计了双路径跨模态循环配准框架:前向配准网络实现跨模态输入对齐,后向配准网络重构原始图像,形成具有几何一致性的闭环结构。此外,我们提出双曲层次对比对齐(H²CA)模块,将图像映射至双曲空间并施加配准约束,有效降低模态差异带来的干扰。我们进一步分析了欧几里得与双曲空间中的图像配准表现,证明双曲空间能实现更敏感、高效的多模态图像配准。在错位多模态图像上的大量实验表明,本方法在图像对齐与融合性能上均显著优于现有方法。代码将公开。
原文摘要 · Abstract (English)
Image fusion synthesizes complementary information from multiple sources, mitigating the inherent limitations of unimodal imaging systems. Accurate image registration is essential for effective multi-source data fusion. However, existing registration methods, often based on image translation in Euclidean space, fail to handle cross-modal misalignment effectively, resulting in suboptimal alignment and fusion quality. To overcome this limitation, we explore image alignment in non-Euclidean space and propose a Hyperbolic Cycle Alignment Network (Hy-CycleAlign). To the best of our knowledge, Hy-CycleAlign is the first image registration method based on hyperbolic space. It introduces a dual-path cross-modal cyclic registration framework, in which a forward registration network aligns cross-modal inputs, while a backward registration network reconstructs the original image, forming a closed-loop registration structure with geometric consistency. Additionally, we design a Hyperbolic Hierarchy Contrastive Alignment (H$^{2}$CA) module, which maps images into hyperbolic space and imposes registration constraints, effectively reducing interference caused by modality discrepancies. We further analyze image registration in both Euclidean and hyperbolic spaces, demonstrating that hyperbolic space enables more sensitive and effective multi-modal image registration. Extensive experiments on misaligned multi-modal images demonstrate that our method significantly outperforms existing approaches in both image alignment and fusion. Our code will be publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。