用持续学习实现全身体积精细分割,一次模型覆盖235个器官。
A Continual Learning-driven Model for Accurate and Generalizable Segmentation of Clinically Comprehensive and Fine-grained Whole-body Anatomies in CT
- 基于持续学习框架,动态扩展新器官分割能力
- 在235个解剖结构上达到高精度,模型仅占5%复杂度
- 适合肿瘤与慢性病研究的CT图像分析应用
精准医疗在慢性病和肿瘤的量化管理中若能对任意患者的计算机断层扫描(CT)进行精确、详细的分割与分析,将极大提升。然而,由于人工标注成本极高、需专业临床知识且耗时长,目前尚无涵盖所有解剖结构的完整标注CT数据集。为此,我们提出一种新型持续学习驱动的CT分割模型——CL-Net,可利用数十个先前部分标注的数据集,动态扩展其对新解剖结构的分割能力,同时不丢失已有知识。现有方法难以在不产生灾难性遗忘的情况下动态分割新器官,且在跨全身区域数百个解剖结构上面临优化困难或不可行问题。CL-Net由一个通用编码器和多个优化剪枝的解码器构成,基于20个公开和16个私有高质量部分标注数据集中的13,952例CT扫描训练而成,涵盖不同厂商、对比相位及病理状态。大量实验表明,CL-Net在准确率上持续优于为每个数据集单独训练的36个专用nnUNet集成模型,且模型复杂度仅为后者的5%,显著超越近期主流基于Segment Anything风格的医学图像基础模型。该持续学习驱动的模型为广泛采用的CT影像在肿瘤学与慢性病中的下游任务提供了坚实基础。
原文摘要 · Abstract (English)
Precision medicine in the quantitative management of chronic diseases and oncology would be greatly improved if the Computed Tomography (CT) scan of any patient could be segmented, parsed and analyzed in a precise and detailed way. However, there is no such fully annotated CT dataset with all anatomies delineated for training because of the exceptionally high manual cost, the need for specialized clinical expertise, and the time required to finish the task. To this end, we proposed a novel continual learning-driven CT model that can segment complete anatomies presented using dozens of previously partially labeled datasets, dynamically expanding its capacity to segment new ones without compromising previously learned organ knowledge. Existing multi-dataset approaches are not able to dynamically segment new anatomies without catastrophic forgetting and would encounter optimization difficulty or infeasibility when segmenting hundreds of anatomies across the whole range of body regions. Our single unified CT segmentation model, CL-Net, can highly accurately segment a clinically comprehensive set of 235 fine-grained whole-body anatomies. Composed of a universal encoder, multiple optimized and pruned decoders, CL-Net is developed using 13,952 CT scans from 20 public and 16 private high-quality partially labeled CT datasets of various vendors, different contrast phases, and pathologies. Extensive evaluation demonstrates that CL-Net consistently outperforms the upper limit of an ensemble of 36 specialist nnUNets trained per dataset with the complexity of 5% model size and significantly surpasses the segmentation accuracy of recent leading Segment Anything-style medical image foundation models by large margins. Our continual learning-driven CL-Net model would lay a solid foundation to facilitate many downstream tasks of oncology and chronic diseases using the most widely adopted CT imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。