针对牙科CBCT图像,提出自适应纹理掩码方法提升自监督学习效果。
Adaptive Texture-aware Masking for Self-Supervised Learning in 3D Dental CBCT Analysis

- 根据切片间纹理变化识别复杂区域,选择性掩码关键结构。
- 在3项下游任务中,模型性能超越随机掩码与现有基线。
- 首次构建6314例大规模牙科CBCT数据集,适合研究者使用。
锥形束计算机断层扫描(CBCT)在牙科三维诊断成像中至关重要,但其深度学习模型发展受限于高质量标注数据稀缺。自监督学习(SSL),尤其是掩码图像建模(MIM),为利用无标签数据提供了可能。然而,传统MIM依赖随机掩码,无法聚焦牙科CBCT中重要的病理细微变化和解剖边界等关键区域。为此,本文提出ATMask,一种自适应掩码策略:通过计算切片间的纹理变化图,识别结构或纹理复杂的高变区域,并优先对这些区域进行掩码,迫使模型学习更丰富的上下文表征,以捕捉复杂的三维形态演变。此外,本文构建了首个大规模牙科CBCT数据集,整合公开与私有来源,共含6,314例扫描。在三个下游牙科CBCT任务上的实验表明,ATMask相比标准随机掩码及其他先进自监督基线,实现了更高效、更强的表示学习能力。相关数据与代码将公开发布。
原文摘要 · Abstract (English)
Cone Beam Computed Tomography (CBCT) is pivotal for 3D diagnostic imaging in dentistry. However, the development of robust AI models for volumetric analysis is often constrained by the scarcity of large, annotated datasets. Self-supervised learning (SSL), particularly Masked Image Modeling (MIM), offers a promising pathway to leverage unlabeled data. A limitation of standard MIM is its reliance on random masking, which fails to prioritize diagnostically critical regions in dental CBCT volumes, such as subtle pathological changes and intricate anatomical boundaries. To address this, we propose ATMask, a novel adaptive masking strategy. Instead of applying random masks or employing computationally intensive attention modules, ATMask computes an inter-slice texture variation map to identify regions with high structural or textural complexity. These high-variation areas are then selectively masked during pre-training, compelling the model to learn richer contextual representations essential for inferring complex 3D morphological transitions. Furthermore, we contribute the first large-scale CBCT dataset, curated from both public and private sources, comprising 6,314 scans, for the dental AI model pretraining. Extensive experiments on three downstream dental CBCT tasks demonstrate that our ATMask enables more data-efficient and powerful representation learning than standard random masking and other advanced SSL baselines. The dataset and code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。