无需训练,用少量涂鸦和稀疏视角即可精准选中3D场景中的物体。
GaussianSelector: Lightweight Human-Guided Object Selection in 3D Gaussian Splatting with Graph Optimization

- 将稠密高斯点聚类为几何连贯的超点,构建带权重的图结构。
- 通过可见性感知传播稀疏涂鸦,在全局图割中完成3D对象选择。
- 支持多轮迭代修正,适合真实场景下人机协同的3D编辑与资产提取。
从重建场景中以最少用户操作选取完整3D物体,对实际场景编辑与具身交互至关重要。现有基于3DGS的方法要么需重训练高斯表示以嵌入物体标签,要么依赖密集多视角SAM观测,均需大量计算与稠密视点覆盖,难以在实际中应用。本文提出GaussianSelector,一种无需训练的交互式3D物体选择框架,支持稀疏视角与稀疏涂鸦引导。直接在原始高斯原语上操作,将稠密高斯聚类为几何连贯的超点,结合外观与空间线索构建连续性加权图。稀疏用户涂鸦通过可见性感知的透射覆盖率提升至3D空间,选择问题转化为全局图割能量最小化,实现稀疏证据向完整3D物体的传播。该设计天然支持多轮精炼,用户可从新增视角迭代修正结果,逐步优化。实验表明,GaussianSelector在选择质量上媲美前沿多视角SAM方法,同时所需交互视点更少,计算开销显著降低,适用于真实场景中的人机协同3D编辑与3D资产提取。
原文摘要 · Abstract (English)
Selecting a complete 3D object from a reconstructed scene with minimal user effort is essential for practical scene editing and embodied interaction. Existing 3DGS-based methods either retrain the Gaussian representation to embed per-object labels, or build dense multi-view SAM observations, both requiring heavy computation and dense viewpoint coverage that is rarely available in practice. We present GaussianSelector, a training-free framework for interactive 3D object selection from sparse views and sparse scribble guidance. Operating directly on native Gaussian primitives, we coarsen dense Gaussians into geometrically coherent superpoints and construct a continuity-weighted graph using appearance and spatial cues. Sparse user scribbles are lifted into 3D via visibility-aware transmittance coverage, and selection is solved as a global graph-cut energy minimization that propagates sparse evidence to a complete 3D object. This design naturally supports multi-round refinement, where users iteratively correct the selection from additional viewpoints to progressively improve the result. Experiments demonstrate that GaussianSelector achieves competitive selection quality against state-of-the-art multi-view SAM-based methods, while requiring significantly fewer interaction views and substantially lower computational overhead. These properties make it well suited for human-in-the-loop 3D scene editing and 3D asset extraction in real-world deployment scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。