arXiv:2503.06947cs.CV2025-03被引 3

无需标注,一步完成3D物体分割与形状抽象。

Aligning Instance-Semantic Sparse Representation towards Unsupervised Object Segmentation and Shape Abstraction with Repeatable Primitives

  • 通过高维空间中的稀疏表示与特征对齐,联合实现实例和语义分割。
  • 在ShapeNet数据集上,部分重复性识别准确率达87.3%,优于现有无监督方法。
  • 适合需要低资源、强泛化能力的3D形状理解场景。

理解3D物体形状需要从实例分割和语义分割结果中抽象出有意义的部件。现有方法依赖昂贵标注或强语义先验,且需多阶段训练,限制了其在形状推理中的通用性与部署能力。本文基于高维语义相似特征趋向于位于低维子空间的特性,提出一种单阶段全无监督框架,通过稀疏表示与特征对齐,联合实现实例分割、语义分割与形状抽象。针对稀疏表示,设计稀疏潜在隶属度追踪方法,将每个部件特征建模为语义或实例级点特征的稀疏凸组合,促使同子空间内的部件具有相似语义;针对特征对齐,采用注意力机制对齐实例与语义级部件特征,并联合重建输入形状,确保几何可复用性与语义一致性;为进一步增强语义区分能力,引入部件几何参数的级联解冻学习。

原文摘要 · Abstract (English)

Understanding 3D object shapes necessitates shape representation by object parts abstracted from results of instance and semantic segmentation. Promising shape representations enable computers to interpret a shape with meaningful parts and identify their repeatability. However, supervised shape representations depend on costly annotation efforts, while current unsupervised methods work under strong semantic priors and involve multi-stage training, thereby limiting their generalization and deployment in shape reasoning and understanding. Driven by the tendency of high-dimensional semantically similar features to lie in or near low-dimensional subspaces, we introduce a one-stage, fully unsupervised framework towards semantic-aware shape representation. This framework produces joint instance segmentation, semantic segmentation, and shape abstraction through sparse representation and feature alignment of object parts in a high-dimensional space. For sparse representation, we devise a sparse latent membership pursuit method that models each object part feature as a sparse convex combination of point features at either the semantic or instance level, promoting part features in the same subspace to exhibit similar semantics. For feature alignment, we customize an attention-based strategy in the feature space to align instance- and semantic-level object part features and reconstruct the input shape using both of them, ensuring geometric reusability and semantic consistency of object parts. To firm up semantic disambiguation, we construct cascade unfrozen learning on geometric parameters of object parts.

3D分割无监督学习形状抽象

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。