arXiv:2505.18060cs.CV2025-05TPAMI被引 6

首个语义对应全面综述,提供统一评测与强基线。

Semantic Correspondence: Unified Benchmarking and a Strong Baseline

  • 构建方法分类体系,系统梳理现有技术路线。
  • 整合多基准测试结果,揭示性能差异与配置影响。
  • 提出简单高效基线,达多个数据集最优表现。

语义对应是计算机视觉中的挑战性任务,旨在跨图像匹配具有相同语义信息的关键点。得益于深度学习的快速发展,过去十年取得了显著进展,但对该任务的全面回顾与分析仍显不足。本文首次系统性地开展语义对应方法的综述研究,提出一种基于方法设计类型的分类体系,对现有方法进行归类并深入分析。同时,我们将文献中多种方法在不同基准上的结果汇总成统一对比表格,并附详细配置,以突出性能差异。为进一步理解现有方法的有效性,我们设计了受控实验,分析各组件的作用。最后,提出一个简单而高效的基线模型,在多个基准上达到当前最优性能,为该领域未来研究奠定坚实基础。代码已公开于:https://github.com/Visual-AI/Semantic-Correspondence。

原文摘要 · Abstract (English)

Establishing semantic correspondence is a challenging task in computer vision, aiming to match keypoints with the same semantic information across different images. Benefiting from the rapid development of deep learning, remarkable progress has been made over the past decade. However, a comprehensive review and analysis of this task remains absent. In this paper, we present the first extensive survey of semantic correspondence methods. We first propose a taxonomy to classify existing methods based on the type of their method designs. These methods are then categorized accordingly, and we provide a detailed analysis of each approach. Furthermore, we aggregate and summarize the results of methods in literature across various benchmarks into a unified comparative table, with detailed configurations to highlight performance variations. Additionally, to provide a detailed understanding on existing methods for semantic matching, we thoroughly conduct controlled experiments to analyse the effectiveness of the components of different methods. Finally, we propose a simple yet effective baseline that achieves state-of-the-art performance on multiple benchmarks, providing a solid foundation for future research in this field. We hope this survey serves as a comprehensive reference and consolidated baseline for future development. Code is publicly available at: https://github.com/Visual-AI/Semantic-Correspondence.

语义对应综述基准测试基线

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。