arXiv:2512.11557cs.CV2025-12AAAI被引 2

用SAM2改进3D牙齿分割,准确率达91.9%。

3DTeethSAM: Taming SAM2 for 3D Teeth Segmentation

  • 将SAM2通过多视角渲染适配3D牙齿分割,结合2D-3D投影重建结果
  • 引入提示嵌入生成器、掩码精修器和分类器,提升分割精度与类别识别能力
  • 加入可变形全局注意力模块,兼顾速度与精度,适合临床数字化应用

3D牙齿分割涉及在3D牙科模型中定位牙齿实例并进行语义分类,是数字牙科中的关键但具有挑战性的任务,因其真实牙列结构复杂。本文提出3DTeethSAM,一种针对3D牙齿分割任务的Segment Anything Model 2(SAM2)适配方法。通过从预设视角渲染3D牙齿模型图像,利用SAM2进行2D分割,并采用2D-3D投影完成3D结果重建。由于SAM2性能依赖输入提示且初始输出存在缺陷,同时其为类别无关设计,因此我们引入三个轻量级可学习模块:(1) 提示嵌入生成器,从图像嵌入中提取提示嵌入以实现精准掩码解码;(2) 掩码精修器,增强SAM2初始分割结果;(3) 掩码分类器,对生成掩码进行分类。此外,我们在SAM2图像编码器中引入可变形全局注意力插件(DGAP),显著提升分割精度并加快训练速度。该方法在3DTeethSeg基准上验证,高分辨率3D牙齿网格上取得91.90%的交并比(IoU),达到当前最优水平。

原文摘要 · Abstract (English)

3D teeth segmentation, involving the localization of tooth instances and their semantic categorization in 3D dental models, is a critical yet challenging task in digital dentistry due to the complexity of real-world dentition. In this paper, we propose 3DTeethSAM, an adaptation of the Segment Anything Model 2 (SAM2) for 3D teeth segmentation. SAM2 is a pretrained foundation model for image and video segmentation, demonstrating a strong backbone in various downstream scenarios. To adapt SAM2 for 3D teeth data, we render images of 3D teeth models from predefined views, apply SAM2 for 2D segmentation, and reconstruct 3D results using 2D-3D projections. Since SAM2's performance depends on input prompts and its initial outputs often have deficiencies, and given its class-agnostic nature, we introduce three light-weight learnable modules: (1) a prompt embedding generator to derive prompt embeddings from image embeddings for accurate mask decoding, (2) a mask refiner to enhance SAM2's initial segmentation results, and (3) a mask classifier to categorize the generated masks. Additionally, we incorporate Deformable Global Attention Plugins (DGAP) into SAM2's image encoder. The DGAP enhances both the segmentation accuracy and the speed of the training process. Our method has been validated on the 3DTeethSeg benchmark, achieving an IoU of 91.90% on high-resolution 3D teeth meshes, establishing a new state-of-the-art in the field.

3D分割牙齿建模SAM2医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。