用扩散模型生成无碰撞的3D牙齿,支持缺失牙布局恢复与形状优化
DM-CFO: A Diffusion Model for Compositional 3D Tooth Generation with Collision-Free Optimization
- 通过扩散模型在去噪过程中逐步恢复缺失牙布局,受文本和图结构约束
- 采用分数蒸馏采样交替优化牙齿与牙弓的3D高斯参数,提升生成质量
- 引入邻牙与锚牙间距离正则项,有效避免牙齿相互穿插,适合牙科数字化场景
自动3D牙齿建模在牙科数字化中至关重要。现有方法在组合式3D牙齿生成中面临布局与形状双重优化难题,且基于3D高斯的生成常忽略碰撞检测,导致物体相交。本文提出DM-CFO方法,利用扩散模型在去噪阶段逐步恢复缺失牙布局,受文本和图结构约束;随后通过分数蒸馏采样(SDS)交替优化每颗牙齿及整个牙弓的3D高斯参数;并引入基于邻牙与锚牙间距离的正则项,惩罚牙齿交叉。在三个牙齿设计数据集上的实验表明,该方法显著提升了生成牙齿的多视角一致性与真实感。
原文摘要 · Abstract (English)
The automatic design of a 3D tooth model plays a crucial role in dental digitization. However, current approaches face challenges in compositional 3D tooth generation because both the layouts and shapes of missing teeth need to be optimized.In addition, collision conflicts are often omitted in 3D Gaussian-based compositional 3D generation, where objects may intersect with each other due to the absence of explicit geometric information on the object surfaces. Motivated by graph generation through diffusion models and collision detection using 3D Gaussians, we propose an approach named DM-CFO for compositional tooth generation, where the layout of missing teeth is progressively restored during the denoising phase under both text and graph constraints. Then, the Gaussian parameters of each layout-guided tooth and the entire jaw are alternately updated using score distillation sampling (SDS). Furthermore, a regularization term based on the distances between the 3D Gaussians of neighboring teeth and the anchor tooth is introduced to penalize tooth intersections. Experimental results on three tooth-design datasets demonstrate that our approach significantly improves the multiview consistency and realism of the generated teeth compared with existing methods. Project page: https://amateurc.github.io/CF-3DTeeth/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。