XDG通过轻量化适配3D基础模型,实现高效视觉去歧义,提速超3倍。
XDG: Accelerated Visual Disambiguation

- 直接利用3D模型的相机标记作为判别依据,避免重复计算跨视角几何关系
- 在多个基准上性能媲美顶尖方法,单场景处理节省超10小时时间
- 适用于大规模结构光重建,尤其适合图像数量庞大的场景
视觉混淆(即'复制品问题')仍是结构光重建(SfM)中的关键挑战:视觉相似但物理不同的表面会产生错误匹配,降低重建质量。以往方法依赖几何感知的基础模型特征,但在主干网络之上添加重型Transformer分类器,导致大规模去歧义计算成本高昂。本文提出XDG,一种专为可扩展SfM设计的高效视觉去歧义模型。核心观察是:3D基础模型已具备完成去歧义所需的跨视角几何推理能力,因此应直接适配主干表示,而非在独立的重型解码器中重新学习成对推理。XDG使用轻量级LoRA适配器微调Depth Anything 3,并将相机标记重用于紧凑的成对分类表示。一个小型MLP头预测候选图像对是否观测到同一3D表面。大量实验表明,XDG在准确率与效率之间取得良好平衡:在成对和重建基准上性能媲美当前最先进方法,推理速度提升超过3倍。在包含数千张图像的LaMAR单场景中,XDG节省了超过10小时的去歧义处理时间。代码已开源。
原文摘要 · Abstract (English)
Visual aliasing, also known as the doppelganger problem, remains a key challenge for structure-from-motion (SfM): visually similar but physically distinct surfaces can produce incorrect image matches and degrade reconstruction quality. Previous work mitigates this issue with geometry-aware foundation-model features, but places a heavy transformer classifier on top of the backbone, making large-scale disambiguation expensive. We introduce XDG, an efficient visual disambiguation model designed for scalable SfM. Our key observation is that a 3D foundation model already performs the cross-view geometric reasoning necessary for visual disambiguation, so doppelganger classification should adapt the backbone representation directly rather than relearn pair reasoning in a separate heavy decoder. XDG fine-tunes Depth Anything 3 with lightweight LoRA adapters and repurposes its camera tokens as compact pair-level classification tokens. A compact MLP head predicts whether a candidate image pair observes the same 3D surface. Extensive experiments show that XDG provides a favorable accuracy-efficiency tradeoff: it remains competitive with the state-of-the-art disambiguation method across pairwise and reconstruction benchmarks and delivers more than a 3x inference speedup. On individual LaMAR scenes containing thousands of images, XDG saves more than 10 hours of visual disambiguation processing. Code is available at https://github.com/xtcpete/xdg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。