用扩散模型生成正畸前后牙齿3D数据,解决训练数据不足问题。
TeethGenerator: A two-stage framework for paired pre- and post-orthodontic 3D dental data generation
- 分两阶段生成正畸前后配对的3D牙齿模型。
- 合成数据与真实数据分布接近,提升牙齿排列模型性能。
- 适合牙科影像、医学生成模型研究者使用。
数字正畸是计算机视觉在医疗领域的重要应用。目前临床数据收集,特别是配对的3D正畸牙齿模型获取,仍依赖人工,成为牙齿排列神经网络训练的主要瓶颈。尽管已有大量通用3D形状生成方法,但多数仅针对单个物体,难以生成包含24-32颗分割牙齿的解剖结构化模型。本文提出TeethGenerator,一种两阶段框架,用于合成配对的正畸前与正畸后3D牙齿模型,以支持下游牙齿排列网络的训练。该方法包含两个核心模块:(1) 牙齿形状生成模块,利用扩散模型学习牙齿形态特征分布,生成多样化的正畸后牙齿模型;(2) 牙齿风格生成模块,通过条件输入特定风格,合成对应的正畸前牙齿模型。大量定性和定量实验表明,合成数据与真实正畸数据分布高度一致,并在结合真实数据训练时显著提升牙齿排列性能。代码与数据集已公开于https://github.com/lcshhh/teeth_generator。
原文摘要 · Abstract (English)
Digital orthodontics represents a prominent and critical application of computer vision technology in the medical field. So far, the labor-intensive process of collecting clinical data, particularly in acquiring paired 3D orthodontic teeth models, constitutes a crucial bottleneck for developing tooth arrangement neural networks. Although numerous general 3D shape generation methods have been proposed, most of them focus on single-object generation and are insufficient for generating anatomically structured teeth models, each comprising 24-32 segmented teeth. In this paper, we propose TeethGenerator, a novel two-stage framework designed to synthesize paired 3D teeth models pre- and post-orthodontic, aiming to facilitate the training of downstream tooth arrangement networks. Specifically, our approach consists of two key modules: (1) a teeth shape generation module that leverages a diffusion model to learn the distribution of morphological characteristics of teeth, enabling the generation of diverse post-orthodontic teeth models; and (2) a teeth style generation module that synthesizes corresponding pre-orthodontic teeth models by incorporating desired styles as conditional inputs. Extensive qualitative and quantitative experiments demonstrate that our synthetic dataset aligns closely with the distribution of real orthodontic data, and promotes tooth alignment performance significantly when combined with real data for training. The code and dataset are available at https://github.com/lcshhh/teeth_generator.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。