让3D点云生成同时具备结构与语义一致性
Guided and Unguided Conditional Diffusion Mechanisms for Structured and Semantically-Aware 3D Point Cloud Generation
- 将语义标签嵌入每一点,直接指导扩散过程
- 生成的点云在结构和分割上均更准确
- 适合需要精准语义结构的3D建模任务
生成逼真的3D点云是计算机视觉中的基础问题,广泛应用于遥感、机器人和数字物体建模。现有生成方法主要关注几何特征,而语义信息通常通过外部分割或聚类后加,未融入生成过程。本文提出基于扩散的框架,将每点的语义标签作为条件变量直接嵌入生成过程,引导扩散动态,实现几何与语义的联合合成。该设计使生成的点云在结构上连贯且具备分割感知能力,对象部件在生成过程中被明确表示。通过对比有指导与无指导扩散过程,我们验证了条件变量对扩散动态和生成质量的显著影响。大量实验表明,该方法能生成细节丰富、符合特定部件和特征的3D点云。
原文摘要 · Abstract (English)
Generating realistic 3D point clouds is a fundamental problem in computer vision with applications in remote sensing, robotics, and digital object modeling. Existing generative approaches primarily capture geometry, and when semantics are considered, they are typically imposed post hoc through external segmentation or clustering rather than integrated into the generative process itself. We propose a diffusion-based framework that embeds per-point semantic conditioning directly within generation. Each point is associated with a conditional variable corresponding to its semantic label, which guides the diffusion dynamics and enables the joint synthesis of geometry and semantics. This design produces point clouds that are both structurally coherent and segmentation-aware, with object parts explicitly represented during synthesis. Through a comparative analysis of guided and unguided diffusion processes, we demonstrate the significant impact of conditional variables on diffusion dynamics and generation quality. Extensive experiments validate the efficacy of our approach, producing detailed and accurate 3D point clouds tailored to specific parts and features.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。