用自监督+半监督提升3D腹部创伤检测,仅需78个标注数据。
CT-VDETR: Semi-supervised 3D Trauma Detection in Computed Tomography (CT) scans using Dense Vertex Relative Position Encoding
- 先用1098例CT预训练3D U-Net,再结合改进DETR检测器
- 仅用78个标注样本就达到31.33% [email protected],提升1.53倍
- 适合标注稀缺的3D医学影像检测任务,尤其腹部创伤
腹部CT中创伤损伤的精准检测与定位仍具挑战,因体素级标注稀少且成本高昂。本文提出一种标签高效框架,结合自监督预训练与半监督变压器检测。首先,在1098个CT体积上使用掩码图像建模(MIM)预训练3D U-Net编码器以学习解剖表示;随后,通过特征适配器将编码器特征网格转换为紧凑的标记序列,用于变压器解码,适配V-DETR至密集体积CT。预训练编码器与V-DETR及3D顶点相对位置编码(3D V-RPE)结合,提升不规则形状损伤的定位能力。最后,利用2000个额外无标签体积进行教师-学生一致性正则化。据我们所知,这是首个将3D DETR风格检测器应用于RSNA腹部创伤检测任务的工作。在该基准上,本方法仅使用78个标注训练样本即实现31.33%的测试[email protected],相比纯监督训练提升1.53倍。结果表明,结合医学领域预训练与半监督学习是应对标签稀缺3D医学检测的有效策略。
原文摘要 · Abstract (English)
Accurate detection and localization of traumatic injuries in abdominal CT remain challenging because voxel-level annotations are limited and expensive to obtain. We present a label-efficient framework for 3D abdominal trauma detection that combines self-supervised pretraining with semi-supervised transformer-based detection. First, we use Masked Image Modeling (MIM) on 1098 CT volumes to pretrain a 3D U-Net encoder for anatomical representation learning. Next, we adapt V-DETR to dense volumetric CT through a feature adapter that converts the encoder feature grid into a compact token sequence for transformer decoding. The pretrained encoder is then integrated with V-DETR and 3D Vertex Relative Position Encoding (3D V-RPE) to improve the localization of irregularly shaped injuries. Finally, semi-supervised teacher-student consistency regularization leverages 2,000 additional unlabeled volumes during detector training. To the best of our knowledge, this is the first application of a 3D DETR-style detector to the RSNA abdominal trauma detection task. On this benchmark, the proposed method achieves 31.33% test [email protected] using only 78 labeled training volumes, corresponding to a 1.53x improvement over supervised-only training. These results show that combining medical-domain pretraining with semi-supervised learning is an effective strategy for label-scarce 3D medical detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。