arXiv:2512.18003cs.CV2025-12被引 2

将3D物体分解为带名称的部件,实现端到端命名与分割。

Name That Part: 3D Part Segmentation and Naming

  • 通过双向匹配将隐式部件表示与文本描述对齐,直接完成命名任务。
  • 在1,794个部件的统一本体中实现零样本匹配,支持任意描述查询。
  • 适用于标注引擎等下游任务,可生成高置信度预测结果。

我们研究语义3D部件分割:将物体分解为具有明确名称的部件。尽管已有数据集提供部件标注,但其定义在不同数据集间不一致,限制了鲁棒训练。以往方法仅生成无标签分解或仅检索单个部件,缺乏完整形状标注。我们提出ALIGN-Parts,将部件命名建模为直接集合对齐任务。该方法将形状分解为隐式3D部件表示(partlets),并通过二分图匹配与部件描述对齐。结合3D部件场的几何线索、多视角视觉特征的外观线索,以及基于语言模型生成的用途描述的语义知识。文本对齐损失确保partlets与文本共享嵌入空间,实现理论上开放词汇的匹配机制,前提是数据充足。我们的高效且新颖的一次性3D部件分割与命名方法可应用于多个下游任务,包括作为可扩展的标注引擎。由于模型支持零样本匹配任意描述并提供已知类别的置信度校准预测,经人工验证后,我们构建了一个统一本体,整合PartNet、3DCoMPaT++和Find3D,共包含1,794个唯一3D部件。我们引入两个适用于命名3D部件分割任务的新指标,并展示了新创建的TexParts数据集中的示例。

原文摘要 · Abstract (English)

We address semantic 3D part segmentation: decomposing objects into parts with meaningful names. While datasets exist with part annotations, their definitions are inconsistent across datasets, limiting robust training. Previous methods produce unlabeled decompositions or retrieve single parts without complete shape annotations. We propose ALIGN-Parts, which formulates part naming as a direct set alignment task. Our method decomposes shapes into partlets - implicit 3D part representations - matched to part descriptions via bipartite assignment. We combine geometric cues from 3D part fields, appearance cues from multi-view vision features, and semantic knowledge from language-model-generated affordance descriptions. Text-alignment loss ensures partlets share embedding space with text, enabling a theoretically open-vocabulary matching setup, given sufficient data. Our efficient and novel, one-shot, 3D part segmentation and naming method finds applications in several downstream tasks, including serving as a scalable annotation engine. As our model supports zero-shot matching to arbitrary descriptions and confidence-calibrated predictions for known categories, with human verification, we create a unified ontology that aligns PartNet, 3DCoMPaT++, and Find3D, consisting of 1,794 unique 3D parts. We introduce two novel metrics appropriate for the named 3D part segmentation task. We also show examples from our newly created TexParts dataset.

3D分割部件命名开放词汇多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。