arXiv:2608.06275cs.CVeess.IV2026-08

用手机拍照就能自动识别牙齿位置、编号和分割,适合偏远地区远程看牙。

TLNM: Externally Validated Tooth Detection, Numbering and Segmentation from Smartphone Photographs Using Mask R-CNN

论文配图:TLNM: Externally Validated Tooth Detection, Numbering and Segmentation from Smartphone Photographs Using Mask R-CNN
图 1 · 摘自论文原文
  • 基于Mask R-CNN改进模型,加入白平衡与解剖约束提升准确性
  • 外部数据集上准确率达F1 0.928,比内部测试还高
  • 开源工具包可直接用于基层医疗或远程诊疗

全球数十亿人受口腔健康问题困扰,但专业牙科服务成本高且难获取。现有研究依赖临床级设备,无法用于公众自检。本研究提出一种针对智能手机照片的牙齿定位与编号模型。构建了基于1,272张标注手机图像的定制化Mask R-CNN流程,为应对用户生成数据的差异性,引入两种领域知识机制:掩码灰世界白平衡算法以消除人工色偏,以及解剖结构约束检测层以保证形态合理性并减少误报。系统在内部与外部测试集上均进行了评估,包括消融实验与训练稳定性分析。内部测试中,实例掩码AP50为0.818,类别感知质量得分PQ为0.780,操作F1为0.884;外部数据集上,对应指标分别为0.901、0.832和0.928,尽管人群、设备与采集协议存在差异。推理流程已作为开源容器化API发布。结果表明,消费级手机图像可支持自动化牙齿级解剖映射,为资源匮乏地区的远程筛查与远程牙科提供可扩展、低成本的基础方案。

原文摘要 · Abstract (English)

Oral health issues affect billions of people globally, but the cost and limited access to professional dental care hinder preventive oral healthcare. Research relies on clinical-grade sensors, unavailable for public self-screening. This study introduces a tooth localisation and numbering model for smartphone photographs. We developed a customised Mask Region-based Convolutional Neural Network pipeline trained on 1,272 annotated smartphone images. To address variability in patient-generated health data, the pipeline incorporates two domain-informed mechanisms: a masked gray-world white-balancing algorithm to mitigate artificial colour casts and an anatomically constrained detection layer to enforce structural validity and suppress false positives. The system was evaluated using internal and external testing, descriptive ablation study and training stability analysis. On the internal test set, the model achieved an instance-mask AP50 of 0.818, class-aware PQ of 0.780, and operational F1 of 0.884. On the external dataset, the model achieved an instance-mask AP50 of 0.901, class-aware PQ of 0.832, and operational F1 of 0.928 despite differences in population, sensors, and acquisition protocols. The inference pipeline is available as an open-source, containerised API. These results demonstrate that consumer-grade smartphone imagery can support automated tooth-level anatomical mapping, offering a scalable, potentially low-cost foundation for remote screening and tele-dentistry in resource-constrained environments.

口腔影像手机诊断医学AI远程医疗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。