arXiv:2512.16143cs.CV2025-12NeurIPS

用SAM分割图增强3D零件分割,小部件和边界表现更优

SegGraph: Leveraging Graphs of SAM Segments for Few-Shot 3D Part Segmentation

  • 构建SAM分割图,通过重叠邻接关系建模几何结构
  • 在PartNet-E上提升6.9%以上mIoU,小部件分割准确率显著提高
  • 适合需要精细几何理解的少样本3D分割任务

本文提出一种新型少样本3D零件分割框架SegGraph。尽管2D基础模型在低样本3D分割中展现潜力,但如何有效融合2D知识仍具挑战。现有方法或忽略3D几何结构,或忽视SAM提供的高质量分组线索,导致欠分割和标签不一致。SegGraph通过构建类似地图的分割图,节点代表分割区域,边捕捉重叠与邻接关系,显式学习掩码中的几何特征。通过图神经网络传播2D基础模型特征,并自适应调制节点以学习全局几何结构。为保证区域内语义一致性,采用视图方向加权融合策略,抑制低质量段落贡献。在PartNet-E数据集上的实验表明,该方法相比所有基线至少提升6.9% mIoU。分析显示,其在小部件和零件边界处表现尤为出色,证明了更强的几何理解能力。代码已开源。

原文摘要 · Abstract (English)

This work presents a novel framework for few-shot 3D part segmentation. Recent advances have demonstrated the significant potential of 2D foundation models for low-shot 3D part segmentation. However, it is still an open problem that how to effectively aggregate 2D knowledge from foundation models to 3D. Existing methods either ignore geometric structures for 3D feature learning or neglects the high-quality grouping clues from SAM, leading to under-segmentation and inconsistent part labels. We devise a novel SAM segment graph-based propagation method, named SegGraph, to explicitly learn geometric features encoded within SAM's segmentation masks. Our method encodes geometric features by modeling mutual overlap and adjacency between segments while preserving intra-segment semantic consistency. We construct a segment graph, conceptually similar to an atlas, where nodes represent segments and edges capture their spatial relationships (overlap/adjacency). Each node adaptively modulates 2D foundation model features, which are then propagated via a graph neural network to learn global geometric structures. To enforce intra-segment semantic consistency, we map segment features to 3D points with a novel view-direction-weighted fusion attenuating contributions from low-quality segments. Extensive experiments on PartNet-E demonstrate that our method outperforms all competing baselines by at least 6.9 percent mIoU. Further analysis reveals that SegGraph achieves particularly strong performance on small components and part boundaries, demonstrating its superior geometric understanding. The code is available at: https://github.com/YueyangHu2000/SegGraph.

3D分割少样本学习图神经网络SAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。