复现XFeat并验证其在资源受限设备上的匹配性能与可靠性。
XFeat Revisited: Reproducibility and Evaluation of a Lightweight Image Matcher

- 基于论文与补充材料重实现架构,统一训练细节进行公平评估。
- 在MegaDepth-1500和ScanNet-1500上性能接近甚至超过原版模型。
- 揭示原始设计中部分关键结构的贡献不如宣称显著,且对评估细节敏感。
本文对XFeat——一种专为资源受限硬件设计的轻量级局部特征提取与匹配器——进行了可复现性研究。我们基于论文及补充材料重实现了该架构,重新评估了作者发布的检查点,并对未充分解释的设计选择进行了额外的结构消融实验。由于论文、补充材料与公开代码在主干网络布局、融合模块和训练损失等方面存在差异,本研究区分了重评估与完全复现。实证结果表明,复现模型在MegaDepth-1500和ScanNet-1500上与原版接近甚至更优,支持其在标准图像匹配基准上具备良好精度-效率权衡。消融实验显示,平行关键点分支对半密集匹配重要,但效果不如原论文声称;单跳接连接的位置证据仍不充分。下游任务中,同质图像下的单应性估计结果一致,但Aachen视觉定位任务表现低于报告值,提示评估细节未明确定义。进一步扩展至零样本跨模态匹配(视网膜、热成像-可见光、多模态遥感),XFeat在部分场景有效,但在严重模态偏移下性能显著下降。
原文摘要 · Abstract (English)
We present a reproducibility study of XFeat, a lightweight local feature extractor and matcher designed to identify corresponding points across images efficiently on resource-constrained hardware. We re-implement the architecture based on the paper and supplementary material, re-evaluate the authors' released checkpoint alongside our re-implementation, and conduct additional architectural ablations to examine design choices that were not fully justified in the original work. This distinction between re-evaluation and reproduction is important, as the paper, supplement, and public code differ in several implementation details, including the backbone layout, fusion block, and training losses. Empirically, our reproduced models closely match and, in some cases, outperform the re-evaluated original checkpoint on MegaDepth-1500 and ScanNet-1500, supporting the main claim that XFeat provides a strong accuracy-efficiency trade-off for standard image-matching benchmarks. Our ablations provide a more nuanced view of two architectural arguments from the original paper. In particular, the parallel keypoint branch is important for semi-dense matching, but its benefit is less pronounced than originally claimed, while the evidence for the specific placement of the single skip-connection remains inconclusive. Finally, we reproduce the original downstream evaluations and find close agreement for homography estimation, while Aachen visual localization remains below the reported results, even for the released checkpoint, suggesting sensitivity to underspecified evaluation details. We then extend the analysis to zero-shot out-of-distribution and cross-modal matching across retinal, thermal-visible, and multimodal remote-sensing imagery, where XFeat remains effective in some settings but degrades sharply under severe modality shifts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。