arXiv:2511.03099cs.CV2025-11被引 3

用3张牙科照片实现多视角牙齿3D重建,助力远程正畸诊疗

DentalSplat: Dental Occlusion Novel View Synthesis from Sparse Intra-Oral Photographs

  • 用先验引导的稠密立体匹配初始化点云,解决输入图像过少问题
  • 在仅3张图条件下仍能生成高质量新视角图像,重建精度显著提升
  • 适合临床远程正畸、口腔数字孪生等场景,实用性强

在正畸治疗,尤其是远程医疗场景中,从多视角观察患者咬合情况有助于及时临床决策。近年来,3D高斯点阵(3DGS)在三维重建和新视角合成方面展现出巨大潜力,但传统3DGS流程通常依赖密集多视角输入和精确相机位姿初始化,限制了实际应用。而正畸病例通常仅有三张稀疏图像——前视图及双侧颊面视图,导致重建任务极具挑战性。输入视角极端稀疏严重降低重建质量,且缺乏相机位姿信息进一步增加难度。为此,我们提出DentalSplat,一种基于稀疏牙科影像的高效三维重建框架。该方法首先利用先验引导的稠密立体重建模型初始化点云,再通过尺度自适应剪枝策略提升3DGS训练效率与重建质量。在极端稀疏视角情况下,进一步引入光流作为几何约束,并结合梯度正则化,提升渲染保真度。我们在包含950例临床案例的大规模数据集及195例模拟真实远程成像条件的视频测试集上验证了方法。实验结果表明,本方法能有效处理稀疏输入场景,在牙齿咬合可视化的新视角合成质量上优于现有最优技术。

原文摘要 · Abstract (English)

In orthodontic treatment, particularly within telemedicine contexts, observing patients' dental occlusion from multiple viewpoints facilitates timely clinical decision-making. Recent advances in 3D Gaussian Splatting (3DGS) have shown strong potential in 3D reconstruction and novel view synthesis. However, conventional 3DGS pipelines typically rely on densely captured multi-view inputs and precisely initialized camera poses, limiting their practicality. Orthodontic cases, in contrast, often comprise only three sparse images, specifically, the anterior view and bilateral buccal views, rendering the reconstruction task especially challenging. The extreme sparsity of input views severely degrades reconstruction quality, while the absence of camera pose information further complicates the process. To overcome these limitations, we propose DentalSplat, an effective framework for 3D reconstruction from sparse orthodontic imagery. Our method leverages a prior-guided dense stereo reconstruction model to initialize the point cloud, followed by a scale-adaptive pruning strategy to improve the training efficiency and reconstruction quality of 3DGS. In scenarios with extremely sparse viewpoints, we further incorporate optical flow as a geometric constraint, coupled with gradient regularization, to enhance rendering fidelity. We validate our approach on a large-scale dataset comprising 950 clinical cases and an additional video-based test set of 195 cases designed to simulate real-world remote orthodontic imaging conditions. Experimental results demonstrate that our method effectively handles sparse input scenarios and achieves superior novel view synthesis quality for dental occlusion visualization, outperforming state-of-the-art techniques.

3D重建正畸医疗新视角合成稀疏输入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。