arXiv:2603.12690cs.CV2026-03被引 1

构建首个跨模态特征匹配综合评测基准,助力红外与可见光图像匹配研究。

CM-Bench: A Comprehensive Cross-Modal Feature Matching Benchmark Bridging Visible and Infrared Images

  • 提出分类网络自适应预处理,自动选择增强策略提升匹配效果。
  • 涵盖30种算法、3类任务,在多个跨模态数据集上系统评估性能。
  • 首次发布红外-卫星跨模态数据集,支持真实场景地理定位评测。

红外-可见光(IR-VIS)特征匹配在跨模态视觉定位、导航与感知中至关重要。尽管深度学习技术快速发展,但因成像差异大,跨模态匹配仍具挑战。当前研究缺乏标准化评测基准与指标。本文提出综合性跨模态特征匹配基准CM-Bench,包含30种不同类型的特征匹配算法,覆盖稀疏、半稠密与稠密方法。通过单应性估计、相对位姿估计及基于特征匹配的地理定位等任务进行评估。引入基于分类网络的自适应预处理前端,可自动选择合适增强策略。同时构建首个红外-卫星跨模态数据集,含人工标注的真值对应关系,用于实际地理定位评估。相关数据与资源将公开于https://github.com/SLZ98/CM-Bench。

原文摘要 · Abstract (English)

Infrared-visible (IR-VIS) feature matching plays an essential role in cross-modality visual localization, navigation and perception. Along with the rapid development of deep learning techniques, a number of representative image matching methods have been proposed. However, crossmodal feature matching is still a challenging task due to the significant appearance difference. A significant gap for cross-modal feature matching research lies in the absence of standardized benchmarks and metrics for evaluations. In this paper, we introduce a comprehensive cross-modal feature matching benchmark, CM-Bench, which encompasses 30 feature matching algorithms across diverse cross-modal datasets. Specifically, state-of-the-art traditional and deep learning-based methods are first summarized and categorized into sparse, semidense, and dense methods. These methods are evaluated by different tasks including homography estimation, relative pose estimation, and feature-matching-based geo-localization. In addition, we introduce a classification-network-based adaptive preprocessing front-end that automatically selects suitable enhancement strategies before matching. We also present a novel infrared-satellite cross-modal dataset with manually annotated ground-truth correspondences for practical geo-localization evaluation. The dataset and resource will be available at: https://github.com/SLZ98/CM-Bench.

跨模态匹配红外可见光地理定位数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。