arXiv:2411.15763cs.CVcs.LG2024-11NeurIPS被引 14

用度量学习优化核心集,实现低标注成本的3D医学分割主动学习

Integrating Deep Metric Learning with Coreset for Active Learning in 3D Segmentation

  • 融合对比学习与医学图像内在分组,构建面向3D分割的度量学习方法
  • 在低标注预算下优于现有方法,弱标注与全标注场景均表现优异
  • 适合医疗影像领域,尤其适用于切片级主动学习以降低标注成本

深度学习在机器学习中取得了显著进展,但通常需要大量标注数据。3D语义分割任务在医学等领域带来巨大标注负担,因专家标注成本高昂。主动学习(AL)有望缓解这一问题,但现有方法大多不针对医学领域。虽然弱监督方法被用于减少标注需求,但其与主动学习的结合尚未探索,而这一结合可大幅降低标注成本。此外,对基于切片的3D分割主动学习关注极少,相比传统的体积分割方法,其成本更低。本文提出一种新的度量学习方法,用于核心集(Coreset)以实现3D医学分割中的切片级主动学习。通过将对比学习与医学图像中的固有数据分组相结合,学习一个强调样本间相关差异的度量,从而训练3D医学分割模型。我们在四个数据集(医学与非医学)上使用弱标注和全标注进行了全面评估。结果表明,该方法在弱标注与全标注场景下均超越现有主动学习技术,在低标注预算下表现更优,这对医学影像至关重要。项目源代码可在补充材料及GitHub获取:https://github.com/arvindmvepa/al-seg。

原文摘要 · Abstract (English)

Deep learning has seen remarkable advancements in machine learning, yet it often demands extensive annotated data. Tasks like 3D semantic segmentation impose a substantial annotation burden, especially in domains like medicine, where expert annotations drive up the cost. Active learning (AL) holds great potential to alleviate this annotation burden in 3D medical segmentation. The majority of existing AL methods, however, are not tailored to the medical domain. While weakly-supervised methods have been explored to reduce annotation burden, the fusion of AL with weak supervision remains unexplored, despite its potential to significantly reduce annotation costs. Additionally, there is little focus on slice-based AL for 3D segmentation, which can also significantly reduce costs in comparison to conventional volume-based AL. This paper introduces a novel metric learning method for Coreset to perform slice-based active learning in 3D medical segmentation. By merging contrastive learning with inherent data groupings in medical imaging, we learn a metric that emphasizes the relevant differences in samples for training 3D medical segmentation models. We perform comprehensive evaluations using both weak and full annotations across four datasets (medical and non-medical). Our findings demonstrate that our approach surpasses existing active learning techniques on both weak and full annotations and obtains superior performance with low-annotation budgets which is crucial in medical imaging. Source code for this project is available in the supplementary materials and on GitHub: https://github.com/arvindmvepa/al-seg.

主动学习3D分割医学影像度量学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。