CNN在牙龋分割中胜过Transformer和Mamba,关键在于任务适配而非模型复杂度。
When CNNs Outperform Transformers and Mambas: Revisiting Deep Architectures for Dental Caries Segmentation
- 在相同条件下对比12种主流模型,发现CNN结构更适应牙片图像分割任务。
- 双通道CNN模型(DoubleU-Net)达到0.7345的Dice系数,领先所有注意力类模型。
- 数据少、空间先验弱时,复杂架构反而表现更差,适合特定医疗场景的模型选择。
全景牙片中牙龋的精准识别与分割对早期诊断和治疗规划至关重要。由于病灶对比度低、形态差异大及标注数据有限,自动分割仍具挑战。本研究首次基于DC1000数据集,系统对比卷积神经网络、视觉变换器与状态空间马尔可夫模型在牙龋分割中的表现。在相同配置下训练了12种前沿架构,包括VMUnet、MambaUNet、VMUNetv2、RMAMamba-S、TransNetR、PVTFormer、DoubleU-Net和ResUNet++。结果表明,尽管注意力机制在理论上更具优势,但基于CNN的DoubleU-Net以0.7345的Dice系数、0.5978的mIoU和0.8145的精确率超越所有变换器与马尔可夫变体,在各项指标中位列前三的均为CNN模型。这说明在数据量有限、空间先验不足的情况下,复杂架构难以发挥优势。研究强调了领域特定医学图像分割中模型与任务的匹配性比模型复杂度更重要。代码已开源:https://github.com/JunZengz/dental-caries-segmentation。
原文摘要 · Abstract (English)
Accurate identification and segmentation of dental caries in panoramic radiographs are critical for early diagnosis and effective treatment planning. Automated segmentation remains challenging due to low lesion contrast, morphological variability, and limited annotated data. In this study, we present the first comprehensive benchmarking of convolutional neural networks, vision transformers and state-space mamba architectures for automated dental caries segmentation on panoramic radiographs through a DC1000 dataset. Twelve state-of-the-art architectures, including VMUnet, MambaUNet, VMUNetv2, RMAMamba-S, TransNetR, PVTFormer, DoubleU-Net, and ResUNet++, were trained under identical configurations. Results reveal that, contrary to the growing trend toward complex attention based architectures, the CNN-based DoubleU-Net achieved the highest dice coefficient of 0.7345, mIoU of 0.5978, and precision of 0.8145, outperforming all transformer and Mamba variants. In the study, the top 3 results across all performance metrics were achieved by CNN-based architectures. Here, Mamba and transformer-based methods, despite their theoretical advantage in global context modeling, underperformed due to limited data and weaker spatial priors. These findings underscore the importance of architecture-task alignment in domain-specific medical image segmentation more than model complexity. Our code is available at: https://github.com/JunZengz/dental-caries-segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。