用关键点追踪提升超声心动图的心肌分割稳定性
Point Tracking as a Temporal Cue for Robust Myocardial Segmentation in Echocardiography Videos
- 通过追踪解剖标志点提供时序运动信号,避免误差累积
- 在低质量视频中分割精度提升,时间一致性显著增强
- 适合需要心肌运动信息的临床下游任务如应变分析
目的:由于对比度低、噪声大和解剖结构变异,超声心动图视频中的心肌分割极具挑战。传统深度学习模型要么独立处理每一帧,忽略时序信息;要么依赖基于记忆的特征传播,导致误差随时间累积。方法:我们提出Point-Seg,一种基于Transformer的分割框架,将点追踪作为时序线索,确保心肌在多帧间的稳定一致分割。该方法利用在合成超声心动图数据集上训练的点追踪模块,追踪视频序列中的关键解剖标志点。这些轨迹提供明确的运动感知信号,引导分割过程,减少漂移且无需依赖记忆特征积累。此外,引入时序平滑损失以进一步增强帧间一致性。结果:我们在公开和私有超声心动图数据集上评估了该方法。实验表明,Point-Seg在高质量超声数据上的分割准确性(Dice)与现有最优模型相当,而在低质量数据上表现更优,且时间稳定性显著提升。更重要的是,相比其他方法,Point-Seg能提供像素级的心肌运动信息,这对心肌应变计算和局部壁运动异常检测等下游任务至关重要。结论:结果表明,点追踪可作为有效时序线索,实现稳定一致的视频分割,为超声心动图视频中的心肌分割提供可靠通用的方法。代码已开源:https://github.com/DeepRCL/PointSeg。
原文摘要 · Abstract (English)
Purpose: Myocardium segmentation in echocardiography videos is a challenging task due to low contrast, noise, and anatomical variability. Traditional deep learning models either process frames independently, ignoring temporal information, or rely on memory-based feature propagation, which accumulates error over time. Methods: We propose Point-Seg, a transformer-based segmentation framework that integrates point tracking as a temporal cue to ensure stable and consistent segmentation of myocardium across frames. Our method leverages a point-tracking module trained on a synthetic echocardiography dataset to track key anatomical landmarks across video sequences. These tracked trajectories provide an explicit motion-aware signal that guides segmentation, reducing drift and eliminating the need for memory-based feature accumulation. Additionally, we incorporate a temporal smoothing loss to further enhance temporal consistency across frames. Results: We evaluate our approach on both public and private echocardiography datasets. Experimental results demonstrate that Point-Seg has statistically similar accuracy in terms of Dice to state-of-the-art segmentation models in high quality echo data, while it achieves better segmentation accuracy in lower quality echo with improved temporal stability. Furthermore, Point-Seg has the key advantage of pixel-level myocardium motion information as opposed to other segmentation methods. Such information is essential in the computation of other downstream tasks such as myocardial strain measurement and regional wall motion abnormality detection. Conclusion: Point-Seg demonstrates that point tracking can serve as an effective temporal cue for consistent video segmentation, offering a reliable and generalizable approach for myocardium segmentation in echocardiography videos. The code is available at https://github.com/DeepRCL/PointSeg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。