用自训练方法在CT中同时3D定位病灶并按部位标记,仅用部分数据达顶尖性能。
3D Universal Lesion Detection and Tagging in CT with Self-Training
- 自训练流程让模型从自身预测中学习,逐步扩展2D检测到3D病灶。
- 仅用DeepLesion数据集30%就实现46.9%敏感度(0.125:8 FP)。
- 首个联合3D病灶检测与解剖部位标签的框架,适合医学影像分析者。
放射科医生在CT检查中需反复进行病灶定位、分类和尺寸测量,耗时且繁琐。通用病灶检测与标记(ULDT)可同时减轻测量负担并支持肿瘤负荷评估。现有方法依赖公开的DeepLesion数据集,但该数据集未提供病灶完整的3D范围,且存在严重类别不平衡问题。本文提出一种自训练流程,在有限30%的DeepLesion子集上训练VFNet模型,实现2D病灶检测与标注;随后将2D上下文扩展为3D,挖掘出的3D病灶建议框回传至训练数据中,多次迭代重训模型。通过自训练,模型逐步学会3D病灶检测与部位标签。结果表明,本方法在仅使用30%数据下达到46.9%平均敏感度([0.125:8]假阳性),与使用完整数据集的方法(46.8%)相当。据我们所知,这是首个实现3D病灶联合部位标签的框架。
原文摘要 · Abstract (English)
Radiologists routinely perform the tedious task of lesion localization, classification, and size measurement in computed tomography (CT) studies. Universal lesion detection and tagging (ULDT) can simultaneously help alleviate the cumbersome nature of lesion measurement and enable tumor burden assessment. Previous ULDT approaches utilize the publicly available DeepLesion dataset, however it does not provide the full volumetric (3D) extent of lesions and also displays a severe class imbalance. In this work, we propose a self-training pipeline to detect 3D lesions and tag them according to the body part they occur in. We used a significantly limited 30\% subset of DeepLesion to train a VFNet model for 2D lesion detection and tagging. Next, the 2D lesion context was expanded into 3D, and the mined 3D lesion proposals were integrated back into the baseline training data in order to retrain the model over multiple rounds. Through the self-training procedure, our VFNet model learned from its own predictions, detected lesions in 3D, and tagged them. Our results indicated that our VFNet model achieved an average sensitivity of 46.9\% at [0.125:8] false positives (FP) with a limited 30\% data subset in comparison to the 46.8\% of an existing approach that used the entire DeepLesion dataset. To our knowledge, we are the first to jointly detect lesions in 3D and tag them according to the body part label.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。