提出旋转等变蒸馏框架,让模型更准更快地匹配图像特征。
REDI-Match: Rotation-Equivariant Distillation for Efficient and Robust Dense Matching

- 用蒸馏将大模型语义转为轻量旋转等变编码器
- 在SatAst上提升13.89%姿态精度,达实时41FPS
- 适合需要高鲁棒性图像匹配的工程应用
视觉基础模型(VFMs)显著提升了密集特征匹配性能,但平面内旋转仍是关键挑战。现有方法面临根本矛盾:数据驱动方法需大量参数隐式学习旋转,而严格等变网络缺乏现代VFMs的语义能力。因此,当前框架通常冻结VFMs,将旋转泛化全部交给下游解码器。为突破此瓶颈,我们提出REDI-Match,基于新型旋转等变蒸馏(REDI)范式。不依赖旋转数据增强建立对应关系,而是将非等变的VFM语义表示蒸馏至轻量、严格旋转等变的编码器,利用等变几何结构约束鲁棒的高维语义。为充分挖掘这些特征,解码器配备熵驱动的空间对齐模块,通过评估离散旋转假设,显式锁定标准坐标系,消除全局歧义后再进行连续优化。大量实验表明,REDI-Match在多个基准上达到新SOTA。尤其在极具挑战性的SatAst数据集上,姿态精度提升13.89%,推理速度比当前SOTA(RoMa v2)快1.9倍,可在单张RTX 4090 GPU上实现约41 FPS的实时推理。代码已开源。
原文摘要 · Abstract (English)
Vision Foundation Models (VFMs) have significantly advanced dense feature matching, yet severe in-plane rotation remains a critical challenge. Existing solutions face a fundamental dilemma: data-driven methods require inefficient parameter scaling to implicitly learn rotations, whereas strictly equivariant networks lack the semantic capacity of modern VFMs. Consequently, current frameworks typically freeze VFMs and shift the entire burden of rotation generalization to the downstream decoder. To break this architectural bottleneck, we propose REDI-Match, an efficient framework driven by a novel Rotation-Equivariant Distillation (REDI) paradigm. Instead of relying on rotation data augmentation to establish rotational correspondences, REDI distills the non-equivariant semantic representations of a VFM into a lightweight, strictly rotation-equivariant encoder, leveraging an equivariant geometric architecture to constrain robust high-dimensional semantics. To fully exploit these features, we equip the decoder with an entropy-driven spatial alignment module. By evaluating discrete rotation hypotheses, this mechanism explicitly locks onto the canonical coordinate system, eliminating global ambiguity before continuous refinement. Extensive experiments demonstrate that REDI-Match establishes a new state-of-the-art (SOTA) across multiple benchmarks. Notably, it achieves a 13.89% absolute pose accuracy improvement on the highly challenging SatAst dataset while operating 1.9x faster than the current SOTA (RoMa v2), enabling real-time inference (~41 FPS) on a single RTX 4090 GPU. Code: https://github.com/YinjiGe/REDI-Match.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。