arXiv:2509.25970cs.CV2025-09

仅需几次点击即可精准分割3D物体的细微部件,提升机器人操作精度。

PinPoint3D: Fine-Grained 3D Part Segmentation from a Few Clicks

  • 通过少量点点击实现细粒度3D部件分割,支持多层级语义理解
  • 首次点击即达55.8%平均IoU,多点击后超71.3%
  • 适用于稀疏点云场景,适合机器人感知与交互任务

细粒度3D部件分割对具身智能系统完成复杂操作任务至关重要,如操控物体特定功能组件。然而,现有交互式分割方法多局限于粗粒度实例级目标,非交互式方法在真实世界稀疏扫描数据上表现不佳,且标注数据严重不足。为此,我们提出PinPoint3D,一种新型交互式细粒度、多粒度3D分割框架,仅需少量用户点击即可生成精确的部件掩码。核心创新在于构建了一个大规模场景级数据集,包含密集部件标注,解决了该领域长期存在的数据瓶颈。实验与用户研究显示,本方法在首次点击设置下,单个部件平均IoU达55.8%,增加少量点击后超过71.3%。相比当前最优基线,性能提升最高达16%,在挑战性稀疏点云中仍保持高效率与高精度。本工作推动了复杂3D环境中机器感知与交互的精细化发展。

原文摘要 · Abstract (English)

Fine-grained 3D part segmentation is crucial for enabling embodied AI systems to perform complex manipulation tasks, such as interacting with specific functional components of an object. However, existing interactive segmentation methods are largely confined to coarse, instance-level targets, while non-interactive approaches struggle with sparse, real-world scans and suffer from a severe lack of annotated data. To address these limitations, we introduce PinPoint3D, a novel interactive framework for fine-grained, multi-granularity 3D segmentation, capable of generating precise part-level masks from only a few user point clicks. A key component of our work is a new 3D data synthesis pipeline that we developed to create a large-scale, scene-level dataset with dense part annotations, overcoming a critical bottleneck that has hindered progress in this field. Through comprehensive experiments and user studies, we demonstrate that our method significantly outperforms existing approaches, achieving an average IoU of around 55.8% on each object part under first-click settings and surpassing 71.3% IoU with only a few additional clicks. Compared to current state-of-the-art baselines, PinPoint3D yields up to a 16% improvement in IoU and precision, highlighting its effectiveness on challenging, sparse point clouds with high efficiency. Our work represents a significant step towards more nuanced and precise machine perception and interaction in complex 3D environments.

3D分割交互式机器人点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。