arXiv:2501.14945cs.CV2025-01CVPR被引 17

一个模型搞定图像匹配所有任务,通用性突破

MATCHA:Towards Matching Anything

  • 用注意力机制动态融合语义与几何特征,生成通用匹配特征
  • 在几何、语义、时间三类匹配任务上均超越现有方法
  • 适合需要跨类型图像对齐的科研与工程场景

图像间对应关系建立是计算机视觉的基础挑战,支撑结构光重建、图像编辑和点跟踪等任务。传统方法通常针对特定类型的对应关系(几何、语义或时间),而人类能自然识别跨域对齐。受此启发,我们提出MATCHA,一种统一特征模型,可实现跨多种匹配任务的鲁棒对应。基于扩散模型特征可编码多类对应关系的洞察,MATCHA通过注意力模块动态融合高层语义与低层几何特征,构建表达能力强、泛化性高的特征。此外,引入DINOv2的物体级特征进一步提升泛化能力,使单一特征即可匹配任意内容。大量实验表明,MATCHA在几何、语义和时间匹配任务中持续优于当前最佳方法,首次实现以单一统一特征有效解决多样化匹配任务,为计算机视觉中的基础对应问题奠定新范式。

原文摘要 · Abstract (English)

Establishing correspondences across images is a fundamental challenge in computer vision, underpinning tasks like Structure-from-Motion, image editing, and point tracking. Traditional methods are often specialized for specific correspondence types, geometric, semantic, or temporal, whereas humans naturally identify alignments across these domains. Inspired by this flexibility, we propose MATCHA, a unified feature model designed to ``rule them all'', establishing robust correspondences across diverse matching tasks. Building on insights that diffusion model features can encode multiple correspondence types, MATCHA augments this capacity by dynamically fusing high-level semantic and low-level geometric features through an attention-based module, creating expressive, versatile, and robust features. Additionally, MATCHA integrates object-level features from DINOv2 to further boost generalization, enabling a single feature capable of matching anything. Extensive experiments validate that MATCHA consistently surpasses state-of-the-art methods across geometric, semantic, and temporal matching tasks, setting a new foundation for a unified approach for the fundamental correspondence problem in computer vision. To the best of our knowledge, MATCHA is the first approach that is able to effectively tackle diverse matching tasks with a single unified feature.

图像匹配统一模型扩散模型特征融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。