arXiv:2607.19111cs.CV2026-07

让3D形状检索在外观相似时靠几何信息区分,不依赖重训练。

GATE-3D: Geometry-Aware Test-time Adaptive Reranking for Open-Set 3D Shape Retrieval

论文配图:GATE-3D: Geometry-Aware Test-time Adaptive Reranking for Open-Set 3D Shape Retrieval
图 1 · 摘自论文原文
  • 根据外观与几何的差异程度,动态调整检索排序。
  • 主基准上mAP@10提升2.00点,几何误检降低10.8%。
  • 轻量级设计适合零样本场景,低数据下线性路由更优。

大型预训练视觉模型显著提升了基于外观的3D形状检索性能,但仍会混淆外观相似但几何不同的形状。尽管引入几何感知特征可减少此类错误,但盲目融合外观与几何特征在两者已对齐时反而损害性能。本文提出GATE-3D,一种无需重训练检索主干的轻量级查询自适应重排序方法。针对每个查询,GATE-3D利用捕捉两模态差异的特征,预测几何感知得分应如何调整基于外观的排名。这种选择性设计使几何信息仅在有益时参与,否则保持沉默。在三个开放集3D检索基准上的实验表明,GATE-3D优于纯外观检索,并且比始终开启融合更鲁棒。在主基准上,其mAP@10相比纯外观检索提升2.00点(p=0.041);同时提升留一类别泛化能力,几何误检降低10.8%。GATE-3D在零样本场景下表现媲美基于DAC的基线方法。进一步发现,在低数据条件下,简单线性路由优于小型MLP,表明跨模态差异特征的重要性超过模型容量。

原文摘要 · Abstract (English)

Large pretrained vision models have substantially improved appearance-based 3D shape retrieval, but they still confuse shapes that look similar while differing in geometry. Although geometry-aware features can reduce these errors, naive fusion of geometry and appearance may hurt retrieval when the two modalities are already well aligned. We propose GATE-3D, a lightweight query-adaptive reranking method that incorporates geometry without retraining the retrieval backbone. For each query, GATE-3D predicts how much a geometry-aware score should adjust the appearance-based ranking using features that capture disagreement between the two modalities. This selective design lets geometry contribute where it helps and stay silent where it would hurt. Experiments on three open-set 3D retrieval benchmarks show that GATE-3D improves over appearance-only retrieval and is more robust than always-on fusion. On the primary benchmark, it improves mAP@10 by 2.00 points over appearance-only retrieval (p=0.041); it also improves leave-one-category-out generalization and reduces geometric false positives by 10.8%. GATE-3D achieves competitive zero-shot results against DAC-based baselines. We further find that simple linear routing is more effective than a small MLP in the low-data regime, suggesting that cross-modal disagreement features matter more than model capacity for adaptive routing.

3D检索几何感知自适应重排序零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。