用自监督ViT提升脑部CT中颅内动脉钙化分割,效果优于传统方法。
Calibrated Self-supervised Vision Transformers Improve Intracranial Arterial Calcification Segmentation from Clinical CT Head Scans
- 基于掩码自编码器预训练自监督ViT,减少标注依赖。
- 分割性能比监督模型高3.2个Dice分数,对厚层扫描更鲁棒。
- 适合临床大规模钙化风险评估,尤其适用于标注少的医疗场景。
视觉变换器(ViTs)在自然图像领域广受关注,但在三维医学图像分割中应用较少。然而,三维ViTs因可在掩码自编码器(MAE)框架下高效进行自监督训练,特别适合处理大型医学影像数据,无需昂贵的人工标注。颅内动脉钙化(IAC)是常规头颅CT可见的影像生物标志物,与中风、痴呆等神经血管疾病相关,自动化量化可实现大规模风险评估。本文首次在大规模临床试验第三国际卒中试验(IST-3)的异构数据上,使用MAE预训练ViT并微调用于IAC分割。实验表明:1)校准后的自监督ViT相比强基线监督模型nnU-Net提升3.2个Dice分数;2)小块尺寸对ViT分割至关重要,且采用常规卷积插值上采样优于转置卷积;3)模型对更高切片厚度更具鲁棒性,在临床风险分组任务中表现提升46%。代码已公开。
原文摘要 · Abstract (English)
Vision Transformers (ViTs) have gained significant popularity in the natural image domain but have been less successful in 3D medical image segmentation. Nevertheless, 3D ViTs are particularly interesting for large medical imaging volumes due to their efficient self-supervised training within the masked autoencoder (MAE) framework, which enables the use of imaging data without the need for expensive manual annotations. Intracranial arterial calcification (IAC) is an imaging biomarker visible on routinely acquired CT scans linked to neurovascular diseases such as stroke and dementia, and automated IAC quantification could enable their large-scale risk assessment. We pre-train ViTs with MAE and fine-tune them for IAC segmentation for the first time. To develop our models, we use highly heterogeneous data from a large clinical trial, the third International Stroke Trial (IST-3). We evaluate key aspects of MAE pre-trained ViTs in IAC segmentation, and analyse the clinical implications. We show: 1) our calibrated self-supervised ViT beats a strong supervised nnU-Net baseline by 3.2 Dice points, 2) low patch sizes are crucial for ViTs for IAC segmentation and interpolation upsampling with regular convolutions is preferable to transposed convolutions for ViT-based models, and 3) our ViTs increase robustness to higher slice thicknesses and improve risk group classification in a clinical scenario by 46%. Our code is available online.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。