提出动态选择最有价值医学影像样本的方法,提升肿瘤分割精度并减少标注成本。
Learning What is Worth Learning: Active and Sequential Domain Adaptation for Multi-modal Gross Tumor Volume Segmentation
- 基于信息量与代表性设计多模态样本筛选策略
- 在多个肿瘤分割任务中显著优于现有自适应方法
- 适合需要高效标注的医学图像分割研究者
鼻咽癌和胶质母细胞瘤的放疗计划依赖于多模态医学数据中肿瘤体积的精准分割。深度神经网络虽在医学图像分割中取得进展,但对标注数据需求增加。由于医学图像标注耗时费力,主动学习通过选取最具信息量的样本降低标注成本,实现高性能模型以最少标注完成训练。现有主动域适应(ADA)方法通过选择与源域差异最大的样本减少冗余,但一次性选择易引发负迁移,且源域数据常受限。此外,多模态数据的查询策略尚未探索。本文提出一种主动且序列化的域适应框架,用于多模态样本的动态选择。通过推导查询策略,优先标注和训练最具价值的样本。在多种肿瘤体积分割任务上的实证验证表明,该方法性能优越,显著超越当前最先进的ADA方法。代码已开源:https://github.com/Hiyoochan/mmActS。
原文摘要 · Abstract (English)
Accurate gross tumor volume segmentation on multi-modal medical data is critical for radiotherapy planning in nasopharyngeal carcinoma and glioblastoma. Recent advances in deep neural networks have brought promising results in medical image segmentation, leading to an increasing demand for labeled data. Since labeling medical images is time-consuming and labor-intensive, active learning has emerged as a solution to reduce annotation costs by selecting the most informative samples to label and adapting high-performance models with as few labeled samples as possible. Previous active domain adaptation (ADA) methods seek to minimize sample redundancy by selecting samples that are farthest from the source domain. However, such one-off selection can easily cause negative transfer, and access to source medical data is often limited. Moreover, the query strategy for multi-modal medical data remains unexplored. In this work, we propose an active and sequential domain adaptation framework for dynamic multi-modal sample selection in ADA. We derive a query strategy to prioritize labeling and training on the most valuable samples based on their informativeness and representativeness. Empirical validation on diverse gross tumor volume segmentation tasks demonstrates that our method achieves favorable segmentation performance, significantly outperforming state-of-the-art ADA methods. Code is available at the git repository: \href{https://github.com/Hiyoochan/mmActS}{mmActS}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。