arXiv:2512.23411cs.CV2025-12

用2D语义增强3D牙齿分割,解决边界模糊和缺失牙识别难题。

SOFTooth: Semantics-Enhanced Order-Aware Fusion for Tooth Instance Segmentation

  • 融合2D语义与3D点云,通过门控机制精修牙齿边界。
  • 在3DTeethSeg'22上实现最高整体准确率和平均交并比。
  • 无需2D标注即可有效识别智齿等稀有牙齿,适合临床应用。

三维(3D)牙齿实例分割因牙列拥挤、牙龈-牙齿边界模糊、缺牙以及临床重要的第三磨牙稀少而面临挑战。依赖几何特征的原生3D方法常出现边界泄漏、中心偏移和实例身份不一致问题,尤其在少数类和复杂解剖结构中表现不佳。相比之下,如Segment Anything Model(SAM)等2D基础模型具备强边界感知语义能力,但直接应用于3D在临床流程中不切实际。为此,我们提出SOFTooth:一种语义增强、顺序感知的2D-3D融合框架,利用冻结的2D语义信息,无需显式的2D掩码监督。首先,点级残差门控模块将咬合视图的SAM嵌入注入3D点特征,以优化牙龈-牙齿及牙间边界。其次,中心引导的掩码精化机制约束实例掩码与几何中心的一致性,减少中心漂移。此外,顺序感知匈牙利匹配策略结合解剖学牙齿顺序与中心距离,在相似性分配中确保标签一致性,即使在缺牙或牙列拥挤情况下亦能保持鲁棒。在3DTeethSeg'22数据集上,SOFTooth达到当前最优的整体准确率与平均交并比,尤其在涉及第三磨牙的病例中显著提升,证明了丰富2D语义可有效迁移至3D牙齿实例分割,且无需进行2D微调。

原文摘要 · Abstract (English)

Three-dimensional (3D) tooth instance segmentation remains challenging due to crowded arches, ambiguous tooth-gingiva boundaries, missing teeth, and rare yet clinically important third molars. Native 3D methods relying on geometric cues often suffer from boundary leakage, center drift, and inconsistent tooth identities, especially for minority classes and complex anatomies. Meanwhile, 2D foundation models such as the Segment Anything Model (SAM) provide strong boundary-aware semantics, but directly applying them in 3D is impractical in clinical workflows. To address these issues, we propose SOFTooth, a semantics-enhanced, order-aware 2D-3D fusion framework that leverages frozen 2D semantics without explicit 2D mask supervision. First, a point-wise residual gating module injects occlusal-view SAM embeddings into 3D point features to refine tooth-gingiva and inter-tooth boundaries. Second, a center-guided mask refinement regularizes consistency between instance masks and geometric centroids, reducing center drift. Furthermore, an order-aware Hungarian matching strategy integrates anatomical tooth order and center distance into similarity-based assignment, ensuring coherent labeling even under missing or crowded dentitions. On 3DTeethSeg'22, SOFTooth achieves state-of-the-art overall accuracy and mean IoU, with clear gains on cases involving third molars, demonstrating that rich 2D semantics can be effectively transferred to 3D tooth instance segmentation without 2D fine-tuning.

牙齿分割2D-3D融合实例分割临床应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。