针对PET/CT图像异质性,提出数据增强与动态集成策略提升病灶分割精度。
Data-Centric Strategies for Overcoming PET/CT Heterogeneity: Insights from the AutoPET III Lesion Segmentation Challenge
- 引入错位增强法缓解模态对齐误差,提升微小病灶分割效果。
- 在5分钟内完成动态集成与测试时增强,兼顾大中小图像的推理效率。
- 方法适用于多示踪剂、多机构场景,具备强泛化能力。
2024年AutoPET III挑战赛首次聚焦数据驱动策略,将重点从模型开发转向通过提升数据质量与处理方式来改善PET/CT图像中的转移性病灶分割。为此,我们提出了两种针对性方法:一是针对PET与CT模态间潜在对齐误差及点状病灶普遍存在的问题,改进基础数据增强方案,并引入错位增强,以提升微小病灶的分割准确性;二是为应对图像尺寸差异导致的预测时间波动,设计了动态集成与测试时增强(TTA)策略,在5分钟预测时间限制内优化集成与TTA的使用,有效利用模型泛化能力,适配不同大小图像。两项方法均在多示踪剂、多机构设置下表现稳健,提供一种通用但影像特性敏感的解决方案。相关代码已公开于GitHub:https://github.com/MIC-DKFZ/miccai2024_autopet3_datacentric。
原文摘要 · Abstract (English)
The third autoPET challenge introduced a new data-centric task this year, shifting the focus from model development to improving metastatic lesion segmentation on PET/CT images through data quality and handling strategies. In response, we developed targeted methods to enhance segmentation performance tailored to the characteristics of PET/CT imaging. Our approach encompasses two key elements. First, to address potential alignment errors between CT and PET modalities as well as the prevalence of punctate lesions, we modified the baseline data augmentation scheme and extended it with misalignment augmentation. This adaptation aims to improve segmentation accuracy, particularly for tiny metastatic lesions. Second, to tackle the variability in image dimensions significantly affecting the prediction time, we implemented a dynamic ensembling and test-time augmentation (TTA) strategy. This method optimizes the use of ensembling and TTA within a 5-minute prediction time limit, effectively leveraging the generalization potential for both small and large images. Both of our solutions are designed to be robust across different tracers and institutional settings, offering a general, yet imaging-specific approach to the multi-tracer and multi-institutional challenges of the competition. We made the challenge repository with our modifications publicly available at \url{https://github.com/MIC-DKFZ/miccai2024_autopet3_datacentric}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。