通过语义感知随机卷积提升医学影像分割的跨域泛化能力
Semantic-aware Random Convolution and Source Matching for Domain Generalization in Medical Image Segmentation
- 基于标注标签对图像不同区域进行差异化增强
- 测试时通过强度映射使目标域数据逼近源域分布
- 在多种跨模态、跨中心场景下超越现有方法
针对医学图像分割中的单源域泛化问题,本文提出一种语义感知随机卷积与源域匹配方法。训练时,根据图像标注标签对不同区域实施差异化的随机卷积增强;测试时,通过映射目标域图像的像素强度,使其更接近源域数据分布。我们在腹部、全心脏和前列腺分割任务上进行了全面评估,涵盖跨模态与跨中心设置,结果表明该方法在绝大多数实验中优于现有域泛化技术。此外,当在全心脏CT或MR数据上训练,测试于不同扫描仪硬件采集的心动周期(收缩期与舒张期)的动态MR数据时,仍保持优异性能。整体表现达到当前医学图像分割域泛化新标杆,部分场景甚至媲美域内基线。
原文摘要 · Abstract (English)
We tackle the challenging problem of single-source domain generalization (DG) for medical image segmentation, where we train a network on one domain (e.g., CT) and directly apply it to a different domain (e.g., MR) without adapting the model and without requiring images or annotations from the new domain during training. Our method diversifies the source domain through semantic-aware random convolution, where different regions of a source image are augmented differently at training-time, based on their annotation labels. At test-time, we complement the randomization of the training domain via mapping the intensity of target domain images, making them similar to source domain data. We perform a comprehensive evaluation on a variety of cross-modality and cross-center generalization settings for abdominal, whole-heart and prostate segmentation, where we outperform previous DG techniques in a vast majority of experiments. Additionally, we also investigate our method when training on whole-heart CT or MR data and testing on the diastolic and systolic phase of cine MR data captured with different scanner hardware. Overall, our evaluation shows that our method achieves new state-of-the-art performance in DG for medical image segmentation, even matching the performance of the in-domain baseline in several settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。