arXiv:2501.14929cs.CVcs.AI2025-01中稿 · oral presentation …被引 4

轻量级时序注意力模块提升心脏解剖分割精度

Motion-enhanced Cardiac Anatomy Segmentation via an Insertable Temporal Attention Module

  • 插入式多头时序注意力模块,可无缝嵌入各类网络
  • 在多个2D/3D超声与MRI数据集上显著提升分割性能
  • 计算高效且通用,适合现有及未来模型升级

心脏解剖分割对临床心脏形态评估具有重要意义。深度学习结合运动信息可提升分割精度,但现有方法存在计算成本高、鲁棒性差等问题,如依赖非深度学习的运动配准、非注意力模型或单头注意力机制,且难以融入现有网络。本文提出一种轻量级、可即插即用的时序注意力模块(Temporal Attention Module, TAM),通过多头跨时序注意力实现稳健的运动增强。TAM可嵌入各类分割网络(基于CNN、Transformer或混合架构),无需修改主干结构,具备高度适应性与集成便利性。在多个2D和3D心脏超声与MRI数据集上的大量实验表明,TAM能持续提升分割性能,同时保持计算效率,并优于当前报道结果,证明其在运动感知增强中具有强鲁棒性、通用性与可扩展性(如从2D到3D)。

原文摘要 · Abstract (English)

Cardiac anatomy segmentation is useful for clinical assessment of cardiac morphology to inform diagnosis and intervention. Deep learning (DL), especially with motion information, has improved segmentation accuracy. However, existing techniques for motion enhancement are not yet optimal, and they have high computational costs due to increased dimensionality or reduced robustness due to suboptimal approaches that use non-DL motion registration, non-attention models, or single-headed attention. They further have limited adaptability and are inconvenient for incorporation into existing networks where motion awareness is desired. Here, we propose a novel, computationally efficient Temporal Attention Module (TAM) that offers robust motion enhancement, modeled as a small, multi-headed, cross-temporal attention module. TAM's uniqueness is that it is a lightweight, plug-and-play module that can be inserted into a broad range of segmentation networks (CNN-based, Transformer-based, or hybrid) for motion enhancement without requiring substantial changes in the network's backbone. This feature enables high adaptability and ease of integration for enhancing both existing and future networks. Extensive experiments on multiple 2D and 3D cardiac ultrasound and MRI datasets confirm that TAM consistently improves segmentation across a range of networks while maintaining computational efficiency and improving on currently reported performance. The evidence demonstrates that it is a robust, generalizable solution for motion-awareness enhancement that is scalable (such as from 2D to 3D).

心脏分割注意力机制医学影像时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。