arXiv:2606.08014cs.CVcs.AI2026-06

不训练即可实现高精度3D实例分割,靠几何与视觉对应消除模型偏见。

GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence

论文配图:GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence
图 1 · 摘自论文原文
  • 利用3D几何与2D视觉的对应关系,避免多模型融合时的置信度偏差。
  • 在ScanNet、S3DIS等数据集上达到当前最佳性能,尤其在开放词汇场景表现突出。
  • 无需微调,兼容多种预训练模型,适合部署于资源受限场景。

点云中的精确3D实例分割对机器视觉应用至关重要。近期方法借助多个预训练基础模型生成3D候选框,并通过候选框聚合提升性能,但因不同分割模型间置信度差异导致结果次优,产生对高置信模型的偏倚。该偏倚具有模型依赖性,受数据预处理和训练策略影响。为此,本文提出一种无需训练的3D实例分割方法GVC-Seg,通过几何视觉对应关系缓解置信度偏倚。同时引入3D候选框生成模块与掩码感知CLIP特征提取模块,分别用于实例掩码生成与语义推理。该方法提升了候选框评估质量,实现跨模型无偏集成。大量实验表明,本方法在多个挑战性基准(如ScanNet、S3DIS)上达到领先性能,并展现出强大的开放词汇语义分割潜力。

原文摘要 · Abstract (English)

Accurate 3D instance segmentation in point cloud data is critical for machine vision applications. Recent advancements leverage multiple pre-trained foundation models to generate 3D proposals, followed by the application of proposal aggregation methods, which significantly enhance performance. However, they often produce sub-optimal results due to inherent variations in confidence levels across different segmentation models, resulting in a bias toward the model with higher confidence. This bias is inherently model-dependent and is influenced by factors such as data preprocessing techniques and training strategies. To address this bias, we propose a novel, training-free 3D instance segmentation approach via Geometric Visual Correspondence (GVC-Seg), which exploits the correspondence between 3D geometric cues and 2D visual cues to mitigate the confidence bias. Additionally, a 3D proposal generation module and a mask-aware CLIP feature extraction module are introduced during the instance mask generation and instance semantic reasoning, respectively. In this way, GVC-Seg enhances proposal quality assessment, ensuring unbiased ensemble learning across different models. Extensive experiments demonstrate that our method achieves state-of-the-art performance on several challenging benchmarks, while also exhibiting strong potential in open-vocabulary semantic segmentation settings.

3D分割实例分割无训练视觉几何

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。