arXiv:2509.23709cs.GRcs.CV2025-09

通过结构图控制3D点云生成,实现用户指定形状的精准建模。

StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer

  • 用部件存在与邻接关系构建结构图,实现对生成形状的结构控制。
  • 在ShapeNet上达到当前最优可控生成性能,生成多样且高质量点云。
  • 适合需要精确形状控制的工业设计、虚拟现实等场景。

在3D点云生成领域,尽管众多生成模型已能生成多样且逼真的3D形状,但多数方法难以生成满足用户特定需求的可控3D点云,限制了其大规模应用。为解决3D点云生成缺乏控制的问题,我们首次提出通过包含部件存在性和部件邻接关系的形状结构来控制点云生成。通过人工标注点云形状各部件间的邻接关系,构建结构图(StructureGraph)表示。基于该结构图,我们提出StrucADT——一种新型结构可控点云生成模型,包含结构感知特征提取模块(StructureGraphNet)、由部件邻接关系控制的潜变量分布学习模块(cCNF Prior),以及基于潜变量和部件邻接条件生成结构一致点云的扩散变压器模块(Diffusion Transformer)。实验表明,本方法可生成高质量且多样的点云形状,支持基于用户指定结构的可控生成,在ShapeNet数据集上达到当前最优性能。

原文摘要 · Abstract (English)

In the field of 3D point cloud generation, numerous 3D generative models have demonstrated the ability to generate diverse and realistic 3D shapes. However, the majority of these approaches struggle to generate controllable 3D point cloud shapes that meet user-specific requirements, hindering the large-scale application of 3D point cloud generation. To address the challenge of lacking control in 3D point cloud generation, we are the first to propose controlling the generation of point clouds by shape structures that comprise part existences and part adjacency relationships. We manually annotate the adjacency relationships between the segmented parts of point cloud shapes, thereby constructing a StructureGraph representation. Based on this StructureGraph representation, we introduce StrucADT, a novel structure-controllable point cloud generation model, which consists of StructureGraphNet module to extract structure-aware latent features, cCNF Prior module to learn the distribution of the latent features controlled by the part adjacency, and Diffusion Transformer module conditioned on the latent features and part adjacency to generate structure-consistent point cloud shapes. Experimental results demonstrate that our structure-controllable 3D point cloud generation method produces high-quality and diverse point cloud shapes, enabling the generation of controllable point clouds based on user-specified shape structures and achieving state-of-the-art performance in controllable point cloud generation on the ShapeNet dataset.

3D生成结构控制扩散模型点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。