用最优传输建模解剖结构全局依赖,提升医学图像分割泛化能力
L2GNet: Optimal Local-to-Global Representation of Anatomical Structures for Generalized Medical Image Segmentation
- 通过离散码的最优传输学习全局关系,避免冗余区域干扰
- 在多器官和心脏数据集上优于SOTA方法,错误率显著降低
- 无需额外权重矩阵,计算高效,适合临床部署
连续潜空间(CLS)与离散潜空间(DLS)模型(如AttnUNet、VQUNet)在医学图像分割中表现优异。协同连续与离散潜空间(CDLS)模型虽能处理细粒度与粗粒度信息,但难以建模长程依赖。基于自注意力的模型(如TransUNet、SynergyNet)虽擅长捕捉长程依赖,但依赖特征池化或聚合,易关注冗余区域,影响解剖结构理解,导致类内/类间依赖建模困难,增加假阴性,削弱泛化能力。为此,我们提出L2GNet,通过最优传输关联DLS获得的离散码,并在可训练参考上对齐,实现无额外权重矩阵的动态表征学习,计算高效。大量实验表明,L2GNet在多器官与心脏分割数据集上优于当前最优方法,包括CDLS模型SynergyNet,为提升深度学习在医学图像分析中的性能提供了新思路。
原文摘要 · Abstract (English)
Continuous Latent Space (CLS) and Discrete Latent Space (DLS) models, like AttnUNet and VQUNet, have excelled in medical image segmentation. In contrast, Synergistic Continuous and Discrete Latent Space (CDLS) models show promise in handling fine and coarse-grained information. However, they struggle with modeling long-range dependencies. CLS or CDLS-based models, such as TransUNet or SynergyNet are adept at capturing long-range dependencies. Since they rely heavily on feature pooling or aggregation using self-attention, they may capture dependencies among redundant regions. This hinders comprehension of anatomical structure content, poses challenges in modeling intra-class and inter-class dependencies, increases false negatives and compromises generalization. Addressing these issues, we propose L2GNet, which learns global dependencies by relating discrete codes obtained from DLS using optimal transport and aligning codes on a trainable reference. L2GNet achieves discriminative on-the-fly representation learning without an additional weight matrix in self-attention models, making it computationally efficient for medical applications. Extensive experiments on multi-organ segmentation and cardiac datasets demonstrate L2GNet's superiority over state-of-the-art methods, including the CDLS method SynergyNet, offering an novel approach to enhance deep learning models' performance in medical image analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。